-- Logs begin at Thu 2022-06-23 08:26:11 UTC, end at Thu 2022-06-23 09:31:52 UTC. -- Jun 23 08:56:03.281079 dv-cinder-847274-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 08:56:03.292951 dv-cinder-847274-1-smb devstack@keystone.service[80392]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 08:56:03 2022] *** Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: nodename: dv-cinder-847274-1-smb Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: machine: x86_64 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: clock source: unix Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: pcre jit disabled Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: detected number of CPU cores: 4 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: current working directory: / Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: detected binary path: /usr/bin/uwsgi-core Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: your processes number limit is 47680 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: your memory page size is 4096 bytes Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: detected max file descriptor number: 2048 Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: lock engine: pthread robust mutexes Jun 23 08:56:03.295289 dv-cinder-847274-1-smb devstack@keystone.service[80392]: thunder lock: enabled Jun 23 08:56:03.296117 dv-cinder-847274-1-smb devstack@keystone.service[80392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 08:56:03.296117 dv-cinder-847274-1-smb devstack@keystone.service[80392]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 08:56:03.339478 dv-cinder-847274-1-smb devstack@keystone.service[80392]: Python main interpreter initialized at 0x55cd147799c0 Jun 23 08:56:03.339478 dv-cinder-847274-1-smb devstack@keystone.service[80392]: python threads support enabled Jun 23 08:56:03.339478 dv-cinder-847274-1-smb devstack@keystone.service[80392]: your server socket listen backlog is limited to 100 connections Jun 23 08:56:03.339478 dv-cinder-847274-1-smb devstack@keystone.service[80392]: your mercy for graceful operations on workers is 90 seconds Jun 23 08:56:03.339808 dv-cinder-847274-1-smb devstack@keystone.service[80392]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 08:56:03.339884 dv-cinder-847274-1-smb devstack@keystone.service[80392]: *** Operational MODE: preforking *** Jun 23 08:56:03.340165 dv-cinder-847274-1-smb devstack@keystone.service[80392]: *** uWSGI is running in multiple interpreter mode *** Jun 23 08:56:03.340165 dv-cinder-847274-1-smb devstack@keystone.service[80392]: spawned uWSGI master process (pid: 80392) Jun 23 08:56:03.340357 dv-cinder-847274-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 08:56:03.344325 dv-cinder-847274-1-smb devstack@keystone.service[80392]: spawned uWSGI worker 1 (pid: 80402, cores: 1) Jun 23 08:56:03.344325 dv-cinder-847274-1-smb devstack@keystone.service[80392]: spawned uWSGI worker 2 (pid: 80403, cores: 1) Jun 23 08:56:03.344325 dv-cinder-847274-1-smb devstack@keystone.service[80392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 08:56:08.782221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:56:08.782221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: from cryptography.utils import int_from_bytes Jun 23 08:56:08.783007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:56:08.783007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: from cryptography.utils import int_from_bytes Jun 23 08:56:08.783114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:56:08.783114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: from cryptography.utils import int_from_bytes Jun 23 08:56:08.783519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 08:56:08.783519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: from cryptography.utils import int_from_bytes Jun 23 08:56:08.831647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:56:08.831847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:56:08.832069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] command line args: [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:56:08.832172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 08:56:08.832341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:56:08.832422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 08:56:08.832506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ================================================================================ {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:56:08.832581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] command line args: [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 08:56:08.832759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] admin_token = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.832849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 08:56:08.832964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ================================================================================ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 08:56:08.833051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] config_dir = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] admin_token = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] config_source = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_dir = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] debug = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.833959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] config_source = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] debug = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.834962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_config_append = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_dir = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_config_append = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_file = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.835984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_dir = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.836955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.837855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.838946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] publish_errors = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.839937 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] publish_errors = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.840985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] standard_threads = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] standard_threads = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] use_journal = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.841983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] use_json = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] use_stderr = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_journal = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] use_syslog = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_json = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_stderr = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.842812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] use_syslog = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.842968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 08:56:08.843228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.843980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.844948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.845996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.846955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.847922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.848914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.849989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.850923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.851871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.852474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.852650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.852737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.852884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.853871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.854956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.855986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.856971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.857994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.858936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.859940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.860916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.861980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.862920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.863976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.864904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.865993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.866991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.867188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.867275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.867426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.867542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.868917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.external = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.external = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.869986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.password = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] auth.token = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.password = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] auth.token = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.870931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.871981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.872961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.873905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.874896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.875904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.876893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.877998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.878951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.879891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.880938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.881874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.882847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.883846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.884937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.885945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.886899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.887988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.888934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.889952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.890898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.891827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.892965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.893961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.894927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.895863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896360 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.896985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.897998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.898974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.899906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.900885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.901996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] role.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] role.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.902936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.903920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.904989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.905989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.906968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.907931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.908930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.909972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.910896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.911845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.912847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.913937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.914016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.914179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.914261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.914925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.915941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.connection = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.916927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.917954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.918884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.919994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.920091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.920168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:56:08.920241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 08:56:08.920390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 08:56:08.950943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.951175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.951278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.951410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.951497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.951669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.959894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.960081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.987996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.988231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.988315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:08.988462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.130601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.130775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.180021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.180274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.182374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.182619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.244935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.245902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.246036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.246120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.246254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.246475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.270701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.270971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.271976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.272117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.272200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.272338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.283639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.283883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.296951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.297968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.298054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.298166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.298258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.298336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.298462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 08:56:09.316021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.316172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.316259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 08:56:09.316386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 08:56:09.316553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.316722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.316808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 08:56:09.316929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 08:56:09.317013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.317984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.328528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.328806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.328891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.329077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.329162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.329361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.329447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.329639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.338219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.338485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.341534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.341799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.341884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.342970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.343989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.344072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.344245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.344334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.344514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.371276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.371545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.372905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.373188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.373269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.373464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.378447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.378715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.378837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.379111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.379192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.379396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.386977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.387215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.387298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.387520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.391709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.392012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.392296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.392937 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.393930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.412925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.413202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.413299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.413531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.417886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.418220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.421521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.421869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.421951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.422272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.426988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.427309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.430646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.430959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.434357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.434649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.434734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.434929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.435847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.436090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.455666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.455966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.456239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.456520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.456606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.456892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.457162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.457439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.464959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.465900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.466640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.466926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.467621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.467911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.470222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.470519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.470820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.471125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.471205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.471462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.471544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.471764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.472100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.472389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.484808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.485087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.485378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.485661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.485750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.485994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.486291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.486576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.487194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.487488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.487777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.488156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.488454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.488752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.507674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.511853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.511985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.515214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.515302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.517028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.518547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.518666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.518942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.519239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.520324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.521986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.522269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.522554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.527149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.528782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.530499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.532029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.532160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.532308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.532697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.532977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.535405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.535698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.536125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.536410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.542073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.542360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.542651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.545575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.545862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.546153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.550553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.550835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.551114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.551384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.551670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.552049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.552352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.552635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.552909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.553190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.553464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.553727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.554004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.554083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 08:56:09.554284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.554365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.554622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.554899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.555213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.555605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.555891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.556190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.556467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.556746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.557022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.557299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.557576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.557846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 08:56:09.593863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd147799c0 pid: 80402 (default app) Jun 23 08:56:09.596968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd147799c0 pid: 80403 (default app) Jun 23 08:56:09.597408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac5f-6d47-4837-9bed-1c0dbab04104 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:09.597703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac5f-6d47-4837-9bed-1c0dbab04104 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:09.597983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ac5f-6d47-4837-9bed-1c0dbab04104 None None] PATH_INFO: `/v3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:09.602214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Jun 23 08:56:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:17.244917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:17.245490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:17.245490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:17.249782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:17.255566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:17.256021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:17.256236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:17.326447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: INFO dbcounter [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] Registered counter for database keystone Jun 23 08:56:17.347425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG oslo_db.sqlalchemy.engines [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:56:17.353571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writer thread running {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:56:17.528411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG passlib.handlers.bcrypt [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80402) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 08:56:17.528840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG passlib.handlers.bcrypt [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80402) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 08:56:17.583036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:17.584671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:17.705819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 23 08:56:17.848212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:17.917948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: INFO dbcounter [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] Registered counter for database keystone Jun 23 08:56:17.937331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG oslo_db.sqlalchemy.engines [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 08:56:17.943674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writer thread running {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 08:56:18.061643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2c036-5453-485f-bd22-5699dd809d08 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:18.066165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:18.066813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:18.067097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:18.067376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:18.075460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:18.127414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 08:56:18.127704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d1fd8-83a2-42c1-b339-27b98d110b9b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:18.137133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jun 23 08:56:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 08:56:18.143048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:18.167377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239931-1fac-468e-9e2e-703b9211f9ed None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:18.171859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:18.173004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:18.173301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:18.173585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] PATH_INFO: `/v3/projects/281f6db1d408416ba80a23879b0e7fcf` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:18.175110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] RBAC: Authorizing `identity:get_project(project_id=281f6db1d408416ba80a23879b0e7fcf)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:18.228871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 08:56:18.229221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd2390-2d64-49e8-a951-31bd6204815c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:18.233821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Jun 23 08:56:18 2022] GET /identity/v3/projects/281f6db1d408416ba80a23879b0e7fcf => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:20.253514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432913-9a55-49de-8a1a-db4d2b9d9b08 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:20.254026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432913-9a55-49de-8a1a-db4d2b9d9b08 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:20.254125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f432913-9a55-49de-8a1a-db4d2b9d9b08 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:20.258826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:20.264278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:20.264710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:20.264845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:20.283333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:20.284886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:20.292594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 08:56:20.314947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432913-9a55-49de-8a1a-db4d2b9d9b08 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:20.327697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f432913-9a55-49de-8a1a-db4d2b9d9b08 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:20.331909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:20.332558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:20.332848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:20.333127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:20.340760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:20.342541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615ea48-c4d2-4a5b-98aa-2d27bde5b3d3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:20.351266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jun 23 08:56:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 08:56:20.356578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:20.368032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285f1f5-597a-4249-975f-a75d21b526df None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:20.372342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:20.373197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:20.373484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:20.373759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:20.375142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:20.376998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5fdc-3677-4596-be92-262a1bd6f33b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:20.378571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Jun 23 08:56:20 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:22.480731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0e9d-a923-41b6-8379-7fbba328a03c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.481260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0e9d-a923-41b6-8379-7fbba328a03c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.481260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0e9d-a923-41b6-8379-7fbba328a03c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.482640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:22.487758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.488190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.488487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.505557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:22.506867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:22.533425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502aa0-9a9b-4192-b4ab-10740b575d51 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.533717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502aa0-9a9b-4192-b4ab-10740b575d51 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.534000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502aa0-9a9b-4192-b4ab-10740b575d51 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.535996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:22.541494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.541803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.542088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.589438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG passlib.handlers.bcrypt [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80403) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 08:56:22.589823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG passlib.handlers.bcrypt [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80403) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 08:56:22.591056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:22.613974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:22.636635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:22.638284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:22.639046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:22.725023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6baf53-7e89-42db-b498-7bc0aed698c9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:22.742885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:22.760749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:22.761552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.761874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.762120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.769677 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:22.773723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:22.785833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:22.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:22.787634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:22.792943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:22.872813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037075-4cdb-46e8-8663-8be278470a4f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:22.875395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:22.886359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:22.905498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e369fd-81bb-4e7f-9621-4bae449a7d37 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:22.913317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:22.914732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.915024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.915333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.942630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:22.943317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:22.943607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:22.943892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:22.944703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:22.945026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:22.946496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:22.958753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:22.964403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:22.995967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.000848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.074658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205e7f-11c1-46ae-8982-8c933f4d4864 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:23.110665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:23.116505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:23.117288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:23.118715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:23.119007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:23.119285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:23.120013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:23.120553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.122154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.123808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:22 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:23.129155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:23.148930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:23.230388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31efcd-04ef-4f01-9002-fbc577d8234d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:23.239861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ae77-1366-46ec-a256-972a8b9922bf None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:23.265929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:23.267063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:23.267560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:23.268101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:23.275976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:23.277045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:23.277534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:23.278006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:23.279424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.281101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.283687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:23.288984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:23.295531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.297056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:56:23.324378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:23.325253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:23.326080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:56:23.326080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:56:23.326080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:56:23.326080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:23.326080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:23.331342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:23.376806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:23.395939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:23.401136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80148b-0631-4c8b-9270-d0d620f99aa1 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:23.437459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:23.438125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:23.438416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:23.438696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:23.439548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.domain.id=default, user.id=8a167a1095c74cccbf02ec7104075bd5) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:23.439875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.441633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a107d-2fe5-47db-a74a-220bdc47dc2e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.445304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c88a61-146e-47eb-95ff-7ab89cdae462 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:23.448791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jun 23 08:56:23 2022] GET /identity/v3/role_assignments?user.id=8a167a1095c74cccbf02ec7104075bd5&scope.domain.id=default&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:23.482600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:23.483306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:23.483569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:23.483846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:23.484636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:23.484948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:23.486388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734f33-447b-4af1-af7f-9d8c7f1b3b6e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:23.512025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:25.867542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900d0-2fde-40bd-9c54-57d4dcd58c35 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:25.868352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900d0-2fde-40bd-9c54-57d4dcd58c35 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:25.868352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a900d0-2fde-40bd-9c54-57d4dcd58c35 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:25.869439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:25.879289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12192e18-b997-48bc-8e8e-e38170dfa83f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:25.879778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12192e18-b997-48bc-8e8e-e38170dfa83f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:25.879853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12192e18-b997-48bc-8e8e-e38170dfa83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:25.909467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-12192e18-b997-48bc-8e8e-e38170dfa83f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:25.910686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-12192e18-b997-48bc-8e8e-e38170dfa83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:25.930224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730aee-dffc-431f-adda-1cc1796fdace None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:25.930508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730aee-dffc-431f-adda-1cc1796fdace None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:25.930975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b730aee-dffc-431f-adda-1cc1796fdace None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:25.932817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 13/23] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:25.938053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:25.938519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:25.938942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:25.962816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:25.965207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:26.031203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:26.033486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b81ef-9d4c-4b69-acab-3ea502b19335 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.034491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b81ef-9d4c-4b69-acab-3ea502b19335 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.035083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b81ef-9d4c-4b69-acab-3ea502b19335 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.037113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 12/25] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:26.042443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.042888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.043308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.069220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:26.071274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:26.107415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:26.113183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.144369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:26.186340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:26.187192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.267041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:26.298705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96492f86-bb37-47c0-8141-2c7777e54859 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:26.341962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:26.344479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.344918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.346358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.371875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:26.385048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:26.386104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:26.387069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:26.397435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 15/28] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:26.398192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.409821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f5a1-974f-4242-b674-78975339b3f3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:26.448303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:26.449377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.449814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.450335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.462750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:26.464618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:56:26.484066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:26.484924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:26.485720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:56:26.485720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:56:26.485720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:56:26.485720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:26.487720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:26.488914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.522333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:26.530000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5624-a34c-426a-bdcd-c95157664963 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:26.568387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:26.569398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.569844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.570404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.571865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:26.573536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdb0fb-36c2-4dbf-b180-08e43f74ea7a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:26.576191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:26.609082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0120ce-2a69-4fec-aa5f-d5094e9c48d6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:26.652156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:26.653052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.653497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.653918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.654811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:26.655264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:26.656930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86458-bc67-4859-a47e-815a94193fa8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:26.669952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 15/30] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:26.671542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1ce1-98b5-4a92-a316-8a7ab55fd01c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.671993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1ce1-98b5-4a92-a316-8a7ab55fd01c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.672430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1ce1-98b5-4a92-a316-8a7ab55fd01c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.673801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 16/31] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:26.674751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1ce1-98b5-4a92-a316-8a7ab55fd01c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.732638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 16/32] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 23 08:56:26 2022] POST /identity/v3/roles => generated 219 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:26.734835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.735489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.735858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.760411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:26.762589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:26.791742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:26.820809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1ce1-98b5-4a92-a316-8a7ab55fd01c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:26.852212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 17/33] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:26.853658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:26.893735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:26.895835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:26.896572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:26.898249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:26.899513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:26.900948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:26.904897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:26.932798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 17/34] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:26.934048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.019615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e3987-e065-4659-9d74-34541ede7a47 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.046466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.061257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.062162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.062450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.062735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.064155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.066029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.067492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d5a3-e105-420a-9fe3-21d6512098d4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.067747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 18/35] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:26 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:27.068917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.107170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.108184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.108648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.109102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.110053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.111612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.189586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a026-3802-4ca1-ae38-b57bf38b1113 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.225803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.226477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.227328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.227610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.228370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.229830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26fe3f-0d61-42e6-bd37-34aca0113016 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.249762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 18/36] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 23 08:56:26 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:27.251392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.273985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.281132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:56:27 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:27.362898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef17-bd40-42dd-8250-d291d467cb79 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.363534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef17-bd40-42dd-8250-d291d467cb79 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.364510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef17-bd40-42dd-8250-d291d467cb79 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.366258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 20/38] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:27.375992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8549d-b4b6-448f-bce4-186fda9b614b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.375992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8549d-b4b6-448f-bce4-186fda9b614b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.375992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8549d-b4b6-448f-bce4-186fda9b614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.403276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61dfd3-f4e0-4662-ad69-bd49f9bc2b16 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.415511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e7d8549d-b4b6-448f-bce4-186fda9b614b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:27.416881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e7d8549d-b4b6-448f-bce4-186fda9b614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:27.453998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.454742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.455029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.455307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.460366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.462672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.464540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 19/39] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:27.473015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.584324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.603513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.610429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c1dfb-11ea-4477-a9c5-722238d41c7b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.633336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:27.634623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc41b0-931e-4619-9e11-478a808e9ef5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.634924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc41b0-931e-4619-9e11-478a808e9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.635209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc41b0-931e-4619-9e11-478a808e9ef5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.636516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 22/41] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:27.641805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.642097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.642383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.651916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.652985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.653413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.653840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] PATH_INFO: `/v3/domains/default/users/8a167a1095c74cccbf02ec7104075bd5/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.656250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8a167a1095c74cccbf02ec7104075bd5, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.657707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.659256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:27.660574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:27.674070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Jun 23 08:56:27 2022] PUT /identity/v3/domains/default/users/8a167a1095c74cccbf02ec7104075bd5/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:27.674876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.742123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 23/43] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:27.766497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:27.786269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e8c2-ba85-4a83-8704-9927432b32a0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.832303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.833262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.833554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.834039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.835095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.836577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.845568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.851846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 21/44] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 23 08:56:27 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:27.885661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7285e-d109-4328-beae-1dbe0f48b633 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:27.889995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:27.927053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:27.928009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:27.928307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:27.928590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:27.930492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:27.932021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf7f36-304b-484f-9a2c-9fc343ff0c9d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:27.934097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 24/45] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:27.939878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:28.050182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e771e5-dba5-4f3c-9a14-4ee1cd63c973 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:28.084767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:28.085437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:28.085728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:28.086037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:28.086767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:28.088241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5d37e-bcd3-402e-90a4-b8bfb4d4c6ec None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:28.114309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:56:27 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:29.686977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fba7-c806-4680-be7d-220a8a74cf95 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:29.687511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fba7-c806-4680-be7d-220a8a74cf95 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:29.687599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fba7-c806-4680-be7d-220a8a74cf95 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:29.688978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:29.694433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:29.694822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:29.695042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:29.711701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:29.713254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:29.758865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:29.787622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:29.811799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1fba7-c806-4680-be7d-220a8a74cf95 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:29.912922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1fba7-c806-4680-be7d-220a8a74cf95 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:29.946453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:29.947246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:29.947537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:29.947820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:29.957764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:29.965463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:29.966439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:29.967403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 26/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:29.972462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.069039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e73e-2df6-400b-8f55-2920e540e2e7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.103061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.103728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.104055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.104339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.105094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:30.105409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.106790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7e77-77ff-4851-a905-0e166ed94506 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.114791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 24/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:30.120314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.122416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367500d-12d5-407e-8a55-bfe2fe81927a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.122717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367500d-12d5-407e-8a55-bfe2fe81927a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.123004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367500d-12d5-407e-8a55-bfe2fe81927a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.124343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 25/51] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:30.129524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.129850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.130133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.152704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:30.231734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371c003-9429-4841-8f38-5e4279b5f984 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.253534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:30.254914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:30.266463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.267347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.267634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.267919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.269152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.270603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.272276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 27/52] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:30 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:30.278137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.289745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:30.323572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 26/53] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:30.347294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.376117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:30.379455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dd699-cdc3-4751-abd1-32efc8cfae8c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.414215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.415007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.415296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.415579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.416870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.418316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.420265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:30.426103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.447502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f38ca5-f75a-46d1-a03c-51215151d70a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.480959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.481803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.482040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.482322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.483505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.484995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.486621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:30.491974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:30.524501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f3047-117f-47f1-bf22-a9f7f7766311 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.532339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:30.557285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.557944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.558237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.558523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.559359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.domain.id=default, user.id=8a167a1095c74cccbf02ec7104075bd5) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:30.559680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.561151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8fc0-2219-4894-a01c-d8f72639d984 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.567164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 29/56] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jun 23 08:56:30 2022] GET /identity/v3/role_assignments?user.id=8a167a1095c74cccbf02ec7104075bd5&scope.domain.id=default&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:30.594236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf3879-cd5c-4515-bd77-ac61d85a0c3d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:30.631087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:30.631758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:30.632074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:30.632356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:30.633647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:30.635117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aec6c-f660-408c-82dc-42767a966a56 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:30.661799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 28/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jun 23 08:56:30 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:56:32.685222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069ccc-91d2-4958-91a6-ba5f4c6666bb None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:32.685705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069ccc-91d2-4958-91a6-ba5f4c6666bb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:32.685793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069ccc-91d2-4958-91a6-ba5f4c6666bb None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:32.687180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:32.692781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:32.693169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:32.693387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:32.709882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:32.711074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:32.775321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:32.799845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069ccc-91d2-4958-91a6-ba5f4c6666bb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:32.831190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:32.900325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069ccc-91d2-4958-91a6-ba5f4c6666bb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:32.933710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:32.934499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:32.934792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:32.935078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:32.936296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:32.937760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570428a2-6f06-47db-aa82-4e9073fc3a12 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:32.939387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:32.945044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:32.967843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:33.040813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc748813-8bf4-49ac-a089-8ebe21662ca4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:33.072715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:33.073377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:33.073663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:33.073939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:33.074646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:33.076105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086b0a-ab87-4310-8c30-76df67b7a067 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:33.100939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:32 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:36.201133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f2d0-b0d9-48e3-bcfb-0ba99eea7212 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.202133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f2d0-b0d9-48e3-bcfb-0ba99eea7212 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.202236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd8da-2098-44d6-8388-c3c04ac92ed8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.202575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd8da-2098-44d6-8388-c3c04ac92ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.202775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd8da-2098-44d6-8388-c3c04ac92ed8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.203083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f2d0-b0d9-48e3-bcfb-0ba99eea7212 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.204669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:36.205293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:36.209437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.209964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.210464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.210565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.210894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.211182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.240854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:36.242626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:36.245544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:36.246697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:36.363535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:36.366066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 32/65] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:36.390293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:36.397692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:36.420310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:36.425594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:36.546647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa06e1-0270-4eeb-9c9c-85e8bdfbcae1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:36.566122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48463cf8-81b5-4772-902f-b8ea56db97fd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:36.630424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:36.631226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.631514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.631796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.632950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:36.633746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.634027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.634304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.655088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:36.662930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:36.663767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:36.665201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:36.665781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:36.674336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:36.676425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:36.678337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:36.680277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 34/66] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:36.680349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 33/67] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:36.682512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:36.685942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:36.757720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:36.781042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:36.793617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4e52-22fd-4b79-a1f8-95f29ada0a00 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:36.795420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46a14c-16fd-4a2f-a0a0-60c34d9390fc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:36.831705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:36.832330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.832618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.832901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.833655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:36.833747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:36.833967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:36.834385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.834675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.834955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.835349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed0220-65fc-4e27-a124-e87c7451391a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:36.835719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:36.836613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:36.838084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae5ae-dd9e-408c-aabf-a78d7558b0d4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:36.844624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 35/68] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:36.845945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ac0-0e4b-4444-9b5d-801f6aed735a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.846235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ac0-0e4b-4444-9b5d-801f6aed735a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.846512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288ac0-0e4b-4444-9b5d-801f6aed735a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.847752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 36/69] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:36.849179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d20e6-0c54-4cac-8da2-aa77a21a1c03 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.849579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d20e6-0c54-4cac-8da2-aa77a21a1c03 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.849869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d20e6-0c54-4cac-8da2-aa77a21a1c03 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.851158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 37/70] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:36.852536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 34/71] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:36.855629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e749-ae22-40b0-b03e-fa2480e04e24 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.855926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e749-ae22-40b0-b03e-fa2480e04e24 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.856468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739e749-ae22-40b0-b03e-fa2480e04e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.856653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d20e6-0c54-4cac-8da2-aa77a21a1c03 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:36.872860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1739e749-ae22-40b0-b03e-fa2480e04e24 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:36.874165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1739e749-ae22-40b0-b03e-fa2480e04e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:36.950472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 35/72] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:36.951754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b31a-b225-4872-a0cb-6fd56ec5e240 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:36.952078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b31a-b225-4872-a0cb-6fd56ec5e240 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:36.952366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b31a-b225-4872-a0cb-6fd56ec5e240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:36.968636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d20e6-0c54-4cac-8da2-aa77a21a1c03 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:36.970895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fe07b31a-b225-4872-a0cb-6fd56ec5e240 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:36.972111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fe07b31a-b225-4872-a0cb-6fd56ec5e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:37.002777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.003660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.003945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.004249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.005430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.006864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.008555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 38/73] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:36 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.010363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.028807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.032002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.042665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 36/74] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:37.045332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58685f34-3ca2-4e22-8498-1b7d86eecb17 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.045634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58685f34-3ca2-4e22-8498-1b7d86eecb17 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.046073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58685f34-3ca2-4e22-8498-1b7d86eecb17 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.049257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 37/75] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:37.049257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58685f34-3ca2-4e22-8498-1b7d86eecb17 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.122135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919414b-767a-49c9-9412-731ebb5bce83 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.165665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58685f34-3ca2-4e22-8498-1b7d86eecb17 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.167686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.169093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.169389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.169681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.184300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.185772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.192171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 39/76] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.192171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.202043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.202859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.203375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.203459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.214186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5e22d88b-4948-4d9c-8fc9-74da6dfa419c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:37.222285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:37.223153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:37.223928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 38/77] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:37.225256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.225256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.225256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.241075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:37.242310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:37.271361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.289258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.294300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d600f-222b-4997-9ff3-c568d3745b97 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.310556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 39/78] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:37.311397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.330342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.331245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.331542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.331826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.400511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.402558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.417334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca9172-3993-4a33-908a-141e7d69861d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.451363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.452181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.452472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.452753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.463311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:37.471062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:37.472054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:37.472814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:37.473438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.483345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.506928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:37.508345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.518776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.575835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63414-34e5-4789-8cab-b859bf687fe1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.609950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8a1ed-a6ce-4ff3-a680-971d175f041f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.611642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.612326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.612619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.612906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.643120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.643795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.644114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.644400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.645155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:37.645473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.646862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.659567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.659567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.684951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.686539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.698058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.727064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.755405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f3ee2-ec56-4e10-bf8c-b715c2212105 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.784270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:37.785260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.793192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.794425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.794736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.795010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.796925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.798384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.800043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.800868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.882329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ac050-de14-48ce-80e6-e7c7f4d7bb1e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.898303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0381-2370-42e1-aab6-21cfea6de341 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:37.908749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.918118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.918729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.919021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.919304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.920103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:37.920422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.921812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.929858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 42/84] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.932802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:37.933667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:37.934532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:37.934822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:37.935108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:37.935257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:37.936341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:37.938035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:37.939736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:37.940781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.034054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c4158-b72c-4697-9692-2f8c6729fe6b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.037905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26717654-13d6-4ba3-89a7-e8dbf14b96a4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.066727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.067666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.068064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.068348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.069574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.071161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.071477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.072051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.072348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.072633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.073183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 43/86] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:38.073885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.078316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.079787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.081547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:37 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:38.082316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.129580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.143477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.175476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1d84-a8a3-46b0-8769-55611a77edd5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.184901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aeb8f-a198-43da-b95a-5248344f322a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.208264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.208939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.209230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.209514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.210298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.212351 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.219314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.220217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.220514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.220803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.222014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.223467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.225170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:38.225946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.234918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 44/89] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:38 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:38.235923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.340927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e626b52-200b-4de7-87c6-c944f529da2f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.356654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.373017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f973e-d238-4532-a4df-166b2f31bd24 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.381548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.382221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.382922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.382922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.383629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=8a167a1095c74cccbf02ec7104075bd5) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:38.383980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.385761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.392530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/role_assignments?user.id=8a167a1095c74cccbf02ec7104075bd5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:38.393339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.403145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.416764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.417611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.417804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.418095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.512012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.513513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.530700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689235b4-7c0b-4767-b702-81286b9eff82 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.568785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.569463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.569755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.570038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.570930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:38.571253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.572741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.580596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 47/91] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=b0d592c729db4128afedc886fb5dece6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:38.581484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.635838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 45/92] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:38.641755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.650814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.681198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.732073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ed1b-9f93-43d6-b8cf-f18d9f20acf7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.771447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83776c1-fc8c-4aed-8c28-e165e50328f1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:38.777112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.777783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.778080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.778366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.817663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:38.818697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:38.818991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:38.819298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:38.821328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.822814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.825105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:38.830888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:38.865010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:38.866973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:38.922977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.982052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:38.996786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 48/94] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:38.997231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f119-92be-4697-9f5d-7900b04faba4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:39.005922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:39.076790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:39.077396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:39.077685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:39.077967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:39.078828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:39.079148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:39.080653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:39.093519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 47/95] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:38 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:39.138731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1621be-27a2-4c34-ba09-9a4498d9216e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:39.191193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:39.192202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:39.192491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:39.192771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] PATH_INFO: `/v3/projects/3ae14cfa389a4566baa78e406f0dee4c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:39.195993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] RBAC: Authorizing `identity:get_project(project_id=3ae14cfa389a4566baa78e406f0dee4c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:39.197508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76e3c-808d-4874-8611-3ef1c2bf7432 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:39.199705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:39 2022] GET /identity/v3/projects/3ae14cfa389a4566baa78e406f0dee4c => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:39.209275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:39.363103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d90c-dfdd-40fe-9a62-88aa77d6b694 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:39.399419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:39.400119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:39.400411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:39.400692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:39.401543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=3ae14cfa389a4566baa78e406f0dee4c, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:39.401863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:39.403340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17918aa7-aeaa-4723-adfc-b4abb6b690b5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:39.415469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:39 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=3ae14cfa389a4566baa78e406f0dee4c&role.id=b0d592c729db4128afedc886fb5dece6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:40.908215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5916-0d6a-47c4-a7d9-f3dcd20ad7c2 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:40.908695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5916-0d6a-47c4-a7d9-f3dcd20ad7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:40.908695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5916-0d6a-47c4-a7d9-f3dcd20ad7c2 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:40.910363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:40.915813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:40.916674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:40.917159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:40.941200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:40.942742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:40.962948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:41.029542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:41.065151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5916-0d6a-47c4-a7d9-f3dcd20ad7c2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:41.081841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:41.208723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5916-0d6a-47c4-a7d9-f3dcd20ad7c2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:41.255508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:41.256434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.256727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.257013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.273084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a768519f-02c6-4486-8a07-b9334ba7e5a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:41.281341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:41.282169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:41.282910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 51/100] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:41.291099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:41.306717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d99455-b09f-4fcf-92d8-0ccc9ebda321 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.307005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d99455-b09f-4fcf-92d8-0ccc9ebda321 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.307294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d99455-b09f-4fcf-92d8-0ccc9ebda321 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.308788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 52/101] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:41.323779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.324383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.324920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.368954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:41.370558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:41.471201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 53/102] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 08:56:41.471668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:41.509102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:41.524572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebadb38-9d23-441d-9a63-6de00014dfea None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:41.563176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:41.564245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.564671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.565089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.566387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:41.566829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:41.568379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:41.578907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 50/103] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:41.584826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:41.614246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:41.721968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57741-39dc-46fc-a345-c1d473d0d08b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:41.768415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f271-218a-49b2-83d0-9a0d4b485708 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:41.774394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:41.775505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.776024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.776521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.787994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-7ac48c08-2d81-4c63-ae7f-b63ca4420b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:41.798983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:41.799843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:41.800651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:41.803267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 54/104] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:41.805398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786ee7-c7b2-465c-85b5-fa51dba484f5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.805887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786ee7-c7b2-465c-85b5-fa51dba484f5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.806359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78786ee7-c7b2-465c-85b5-fa51dba484f5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.807817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 55/105] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:41.810640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78786ee7-c7b2-465c-85b5-fa51dba484f5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:41.853234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:41.854166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.854440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.854716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] PATH_INFO: `/v3/users/9715cd02fb7b4101b1a53e343423e4e8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.883572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:41.896697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] RBAC: Authorizing `identity:get_user(user_id=9715cd02fb7b4101b1a53e343423e4e8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:41.898452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cface8d-a2c5-453c-998d-00e6ae0fbb22 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:41.900410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 51/106] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:41 2022] GET /identity/v3/users/9715cd02fb7b4101b1a53e343423e4e8 => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:41.901762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.902183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.902600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.939844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78786ee7-c7b2-465c-85b5-fa51dba484f5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:41.944098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:41.945320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:41.983695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:41.984708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:41.986543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:41.987068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:41.988051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:41.989527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:41.996561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.011022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 56/107] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:42.012318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.130378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70161c4-820f-4f6e-861f-14304863584d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.141724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 52/108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:42.142592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.145111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.155514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.174054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.175562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.176117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.176662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.258348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.260159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e4bb0-4248-458b-8017-2a5d63c9a73f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.301626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fd4c-dc81-40bb-8487-91cbe3f2fa7d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.341389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.342262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.342544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.342818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.344564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.346398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.348553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 53/109] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:42.353501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.374598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 57/110] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:42.376241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0833e-286b-441a-9391-0744f4f37972 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.376534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0833e-286b-441a-9391-0744f4f37972 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.376815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0833e-286b-441a-9391-0744f4f37972 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.378087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 58/111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:42.379146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934638b0-2260-4711-b4ca-41916f986519 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.379435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934638b0-2260-4711-b4ca-41916f986519 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.379711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934638b0-2260-4711-b4ca-41916f986519 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.381077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 59/112] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:42.384787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934638b0-2260-4711-b4ca-41916f986519 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.406382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.424142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.455196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716800-a20a-44f7-a752-eef829c8384d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.484813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934638b0-2260-4711-b4ca-41916f986519 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.488900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.489695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.489985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.490268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.491529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.493055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650b852-b64b-4d90-b70b-f4250d3f7159 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 54/113] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba812a-37a4-4d1d-ab4d-b8a9a777fedc None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba812a-37a4-4d1d-ab4d-b8a9a777fedc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba812a-37a4-4d1d-ab4d-b8a9a777fedc None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 55/114] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:42.499448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba812a-37a4-4d1d-ab4d-b8a9a777fedc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.522723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.524163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.524453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.524735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.525937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.527403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876f090-2c5b-4001-80e2-334b9882321c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.529158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 60/115] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:42.530299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91186ed-d01d-47e7-9840-7bb6335e813e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.530594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91186ed-d01d-47e7-9840-7bb6335e813e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.530942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91186ed-d01d-47e7-9840-7bb6335e813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.547277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c91186ed-d01d-47e7-9840-7bb6335e813e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:42.548512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c91186ed-d01d-47e7-9840-7bb6335e813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:42.600273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba812a-37a4-4d1d-ab4d-b8a9a777fedc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.617830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 61/116] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:42.623278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d131-784d-4609-8124-25988f427995 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.623278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d131-784d-4609-8124-25988f427995 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.623278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d131-784d-4609-8124-25988f427995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.639244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.639870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-63f6d131-784d-4609-8124-25988f427995 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:42.640235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.640527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.640809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.641090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-63f6d131-784d-4609-8124-25988f427995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:42.642110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.643567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.645455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 56/117] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:42.646069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.655379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.655826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.710413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 62/118] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:42.716713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499905f-3327-41c5-b309-1341afb74850 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.716713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499905f-3327-41c5-b309-1341afb74850 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.716713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499905f-3327-41c5-b309-1341afb74850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.728682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1499905f-3327-41c5-b309-1341afb74850 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:42.729876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1499905f-3327-41c5-b309-1341afb74850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:42.752180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453d5f4-41cb-401c-9e46-93350ae462be None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.785626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b403-d206-4f86-883b-16671734f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.786223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b403-d206-4f86-883b-16671734f472 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.786511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b403-d206-4f86-883b-16671734f472 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.786796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b403-d206-4f86-883b-16671734f472 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.787516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490b403-d206-4f86-883b-16671734f472 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.789010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490b403-d206-4f86-883b-16671734f472 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.796973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 63/119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:42.797782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499905f-3327-41c5-b309-1341afb74850 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.828598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 57/120] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:56:42 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:42.829438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b403-d206-4f86-883b-16671734f472 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:42.885310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.902416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:42.911679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499905f-3327-41c5-b309-1341afb74850 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.951706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:42.952653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:42.952941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:42.953219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/8a167a1095c74cccbf02ec7104075bd5/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:42.955386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, user_id=8a167a1095c74cccbf02ec7104075bd5, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:42.956660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b403-d206-4f86-883b-16671734f472 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:42.957092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:42.973120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:42 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/8a167a1095c74cccbf02ec7104075bd5/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:42.974299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.008509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.009338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.009632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.009915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.025008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:43.033205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:43.034166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:43.034942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 58/122] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:43.040745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.124695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e54d4-fdd8-43ba-abfd-5eb84d233b84 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.168707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.169662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.170172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.170660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.171602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=9715cd02fb7b4101b1a53e343423e4e8) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:43.172043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:43.175096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:43.182888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 65/123] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:42 2022] GET /identity/v3/role_assignments?user.id=9715cd02fb7b4101b1a53e343423e4e8&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:43.183647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.186350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:43.189506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edfbc2-2d85-4476-91a3-6ba63cfe2bfa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.214911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:43.235252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.236120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.236469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.236768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.252593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:43.260637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:43.261568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:43.262392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 59/124] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:43.263020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.332062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50f568-5817-4da9-827e-8e477c9e9a33 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.377949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.378786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.379078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.379366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.406615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:43.421683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:43.422586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:43.423370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 66/125] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:43.424066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.493530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:43.526139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e259bec-7f57-4a19-8062-829142d80352 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.535340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799e94-1b5f-4e20-8919-e0ad99c5dc63 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.572892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.573700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.573993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.574277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.575043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:43.575361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:43.576850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:43.590492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 67/126] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:43.591508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.615572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.616373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.616705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.617031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.617795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:43.618108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:43.619550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:43.629533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 60/127] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:43.635175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.684509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:43.781950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881bf50-35a0-4734-8010-e801ecdc3b16 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.804184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa167d04-4adc-47f7-8e37-a0ac3a6df63d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:43.828986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:43.841470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.842084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.842373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.842684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.843494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:43.843811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:43.845335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:43.854687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 68/128] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:43.855558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:43.866120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:43.867044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:43.867332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:43.867611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:43.868846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:43.870292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:43.871939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 61/129] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:43.872733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.012485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc3ac5-e541-40e4-8790-045720e63d3b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.022871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:44.028353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5522-20d2-480d-aaa5-6bc819a763d6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.052429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.053713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.054001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.054283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.055609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.057432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.059456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 62/130] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:44.060073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.118086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.118901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.119195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.119483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.121322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.124695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.126358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 69/131] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:43 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:44.127130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.232299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:44.235904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a20e5f-d54f-4490-a517-039bab1685be None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.299533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.300436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.300786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.301072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.303046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.305087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.307650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 63/132] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:44 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:44.311525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.313730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18180cb-b794-4878-89f8-7ac80e59ae26 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.366438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.367848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.368216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.368440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.369747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.371216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.373131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 70/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:44 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:44.373695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.396492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:44.488259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e02f8-4ad9-4809-8a68-91d2d6cd4a95 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.505708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae675d-a931-4f99-97dd-c0dd72aa47db None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.513472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:44.526992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.527902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.528219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.528501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.530648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, user_id=3703f739dc7b4959a5520ab44eb6f0a3, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.532142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.551993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 71/134] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:44 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:44.553095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.589911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.590429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.590722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.591003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] PATH_INFO: `/v3/projects/3ae14cfa389a4566baa78e406f0dee4c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.593565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ae14cfa389a4566baa78e406f0dee4c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.602629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.609434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 64/135] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:44 2022] GET /identity/v3/projects/3ae14cfa389a4566baa78e406f0dee4c => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:44.617622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:44.784479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756cca-7169-410a-a8ea-8ee196b5f265 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.821699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.822611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.822908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.823189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.825612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, user_id=3703f739dc7b4959a5520ab44eb6f0a3, role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.827089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c41d-e3d5-494c-b8da-fca0327f8c01 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.848420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889d36a-60ec-42e7-a604-2ce1dad6b7b3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:44.851989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 72/136] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:44 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:44.866695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:44.890484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:44.891392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:44.891679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:44.891995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] PATH_INFO: `/v3/projects/3ae14cfa389a4566baa78e406f0dee4c/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:44.896196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae14cfa389a4566baa78e406f0dee4c, user_id=3703f739dc7b4959a5520ab44eb6f0a3, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:44.897720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e595b-2244-4046-a6fe-7fd5f1ef54c5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:44.922548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 65/137] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:44 2022] PUT /identity/v3/projects/3ae14cfa389a4566baa78e406f0dee4c/users/3703f739dc7b4959a5520ab44eb6f0a3/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:45.356949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940327-fce5-4118-8264-ef7e66fff3d2 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.357473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940327-fce5-4118-8264-ef7e66fff3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.357548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30940327-fce5-4118-8264-ef7e66fff3d2 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.358892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 73/138] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:45.364930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c1a5-0d31-4881-9b92-9eb5c73b0f65 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.365335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c1a5-0d31-4881-9b92-9eb5c73b0f65 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.365540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c1a5-0d31-4881-9b92-9eb5c73b0f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.393467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-40c9c1a5-0d31-4881-9b92-9eb5c73b0f65 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:45.394808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-40c9c1a5-0d31-4881-9b92-9eb5c73b0f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:45.489041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 66/139] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:45.533455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30940327-fce5-4118-8264-ef7e66fff3d2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:45.589108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:45.661686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde882b-a2b5-450f-9886-b3e79145ffc7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.661868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde882b-a2b5-450f-9886-b3e79145ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.662158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde882b-a2b5-450f-9886-b3e79145ffc7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.663699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 67/140] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:45.668816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.669103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.669383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.682160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30940327-fce5-4118-8264-ef7e66fff3d2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:45.707554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:45.708794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:45.765524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:45.766343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.766627 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.766902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.768122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:45.769581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1346705-4d6e-4071-9c94-85b484a9207d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:45.774682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 74/141] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:45.774682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d46b7-cd39-4b86-853c-5d99da0e65c0 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.774682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d46b7-cd39-4b86-853c-5d99da0e65c0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.774682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d46b7-cd39-4b86-853c-5d99da0e65c0 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.774682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 75/142] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:45.781163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:45.781451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:45.781732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:45.804172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 68/143] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:45.805539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:45.828917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:45.830799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:45.873164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:45.952693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786b1a-acc5-4afb-9052-fe8cff4723fd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:45.962763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 76/144] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:45.963899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.010123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.010975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.011275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.011559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.012325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.017026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.031406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.045958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 69/145] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:45 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:46.046614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.176194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129a7c-69a2-4264-bb49-8153c8b5b73b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.183549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.199105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d702b39-15e7-40d9-9f08-08e8fa199f66 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.238493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.239229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.239523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.239809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.252591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:46.260733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:46.261664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:46.263165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 70/146] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:46.263859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.264153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.265179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.265179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.267823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.294243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:46.302215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:46.303126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:46.303899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:46.310892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 77/147] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:46.318039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.385509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892a52e-88fb-4f6d-9aa5-ec1df44f53ff None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.428826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.430071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.430367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.430653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.431568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:46.431892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.433453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.443081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 71/148] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:46.448518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.461476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.557929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe14b-5a67-493f-b806-10299b5d1397 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.585038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.600251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.600449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12497d-0d9a-4acb-9c51-5db9c23b364d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.600532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.600532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.600532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] PATH_INFO: `/v3/users/9715cd02fb7b4101b1a53e343423e4e8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.600909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] RBAC: Authorizing `identity:get_user(user_id=9715cd02fb7b4101b1a53e343423e4e8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.602992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.605775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 72/149] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/users/9715cd02fb7b4101b1a53e343423e4e8 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:46.610394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.660649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.661340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.661632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.661915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.662682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:46.662994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.664525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.677141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 78/150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:46.683575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.696294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.721316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6d27f-c6d9-4444-b767-ea6e78bfa758 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.758261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.759136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.759432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.759714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.761059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.762535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.764805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 73/151] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:46.770421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.831634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878458a9-8f25-4425-97d2-72b8212caf0b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.880952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44ebb6-512a-4803-8775-38d40f98819a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:46.889241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.890147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.890440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.890723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] PATH_INFO: `/v3/users/8a167a1095c74cccbf02ec7104075bd5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.896728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] RBAC: Authorizing `identity:get_user(user_id=8a167a1095c74cccbf02ec7104075bd5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.898254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.900178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 79/152] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/users/8a167a1095c74cccbf02ec7104075bd5 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:46.905776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:46.921939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:46.922851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:46.923146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:46.923532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/9715cd02fb7b4101b1a53e343423e4e8/roles/db8ceda7dbe94858ba593290baefcca3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:46.929946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, user_id=9715cd02fb7b4101b1a53e343423e4e8, role_id=db8ceda7dbe94858ba593290baefcca3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:46.931544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:46.948539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:46.961813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 74/153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:46 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/users/9715cd02fb7b4101b1a53e343423e4e8/roles/db8ceda7dbe94858ba593290baefcca3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:47.040028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a148b-84f9-4a3c-9ff5-69ba523ea80f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:47.080671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:47.081361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.081715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.081943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.156666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:47.158148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726c52d-94b5-4eec-b7e6-539a642c2a2f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:47.190707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:47.265759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 80/154] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 08:56:47.271438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:47.285293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:47.439177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6e01f-3a60-4a92-9d10-4f5ad16f9d9e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:47.473464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a208a-bc93-4aa2-ad26-b6e4cb1cd416 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.474210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a208a-bc93-4aa2-ad26-b6e4cb1cd416 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.474728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a208a-bc93-4aa2-ad26-b6e4cb1cd416 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.477021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 81/155] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:47.483037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:47.483585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.483917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.484243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.484527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.484752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.485229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.485765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:47.491372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:47.491372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 75/156] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:47 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:47.494981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:47.522297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:47.524476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:47.579704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:47.610950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0906a-98ef-4350-91e5-6c6c9c7bb3ba None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:47.617798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 82/157] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:47.647464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:47.648741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.649039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.649359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.650182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=8a167a1095c74cccbf02ec7104075bd5) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:47.650502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:47.651995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:47.656538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:47.658951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 76/158] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:47 2022] GET /identity/v3/role_assignments?user.id=8a167a1095c74cccbf02ec7104075bd5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:47.742485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:47.791413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bbb54-23cf-4a59-889d-654fe043090e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:47.830349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:47.831178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:47.831461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:47.831739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:47.843850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:47.854022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:47.855033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:47.855810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 83/159] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:47.861259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:47.989154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95597a-bd54-45e9-b1c4-55b235e400cc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:48.027942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:48.029052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.029546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.030042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.031011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:48.031525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:48.033175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:48.039280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:48.045214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 77/160] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:48.050617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:48.172462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9224b-1780-4209-b085-b0fc06567e15 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:48.193919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:48.212446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:48.213393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.213683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.213963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.215197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:48.216687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf765a-3b8d-4629-a209-48c0af484886 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:48.218337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 84/161] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:48 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:48.223798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:48.354862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ba1d-9db5-40f1-8f90-cc8588a194a9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:48.355271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00361-f98f-47ec-8115-d6abdea803a6 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.355565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00361-f98f-47ec-8115-d6abdea803a6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.355846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00361-f98f-47ec-8115-d6abdea803a6 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.357546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 85/162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:48.362768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.363057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.363343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.396658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:48.397699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.398247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.398748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.400956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:48.402170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:48.475193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:48.479587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:48.481515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:48.592382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 78/163] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:48.594796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 86/164] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:48.597999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:48.632752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:48.747377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:48.753967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6d03-0ae1-41b3-8408-550cfba75b08 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:48.830693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:48.831566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.831847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.832147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.833343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:48.834804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6afc1-c25d-4d1b-aba5-bcdc5cd4c20a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:48.837466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 79/165] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:48 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:48.845178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f5-a05a-4574-a24a-9824ab828884 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.845475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f5-a05a-4574-a24a-9824ab828884 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.845751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef153f5-a05a-4574-a24a-9824ab828884 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.847060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 80/166] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:48.847823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef153f5-a05a-4574-a24a-9824ab828884 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:48.858139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb64f4-cede-447d-968d-5bafb9f713b7 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:48.904419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:48.941789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:48.942620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.942909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.943188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:48.968864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d5c37d8c-2e1a-4b7a-a0e2-8d20ffe80672 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:48.986003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:48.986996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:48.988056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 87/167] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:48.990814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:48.991114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:48.991462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.029191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef153f5-a05a-4574-a24a-9824ab828884 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.035775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:49.037059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:49.074984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:49.075644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:49.075926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:49.076233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.077077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:49.077392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:49.078817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:49.094156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 81/168] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:48 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=b0d592c729db4128afedc886fb5dece6 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:49.094987 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.197165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:49.197557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 88/169] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:49.239699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.345242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c808-78ec-4a7d-8555-6edd23d2ae27 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.415861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8804d6b-ed0a-4154-9e43-40e1f18e97b4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.429969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:49.430648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:49.430936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:49.431214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.432002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:49.432321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:49.433709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:49.437555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:49.453509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 82/170] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:49.460336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.497432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:49.498250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:49.498535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:49.498816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.527707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:49.535675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:49.536594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:49.537373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:49.549367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 89/171] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:49.557489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.678315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:49.694869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a46b7-fbe6-4404-849b-feb9e73ac5f4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.717140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2e3d-2861-4f49-bafb-35665974ee54 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.763866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:49.764561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:49.764848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:49.765127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.765888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:49.766198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:49.767587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:49.774055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:49.774943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:49.775225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:49.775496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:49.776738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:49.778191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:49.780208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 83/172] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:49.786384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.794641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 90/173] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:49.799943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:49.856315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:49.980843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11240e7-d69c-458c-a328-d4f13a36073f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:49.990393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82197101-86f5-433e-a21f-7e0bdeba0676 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.046456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.047115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.047403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.047681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.056791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.057692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.058039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.058327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] PATH_INFO: `/v3/users/3703f739dc7b4959a5520ab44eb6f0a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.059717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] RBAC: Authorizing `identity:get_user(user_id=3703f739dc7b4959a5520ab44eb6f0a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:50.061276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:50.063485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 91/174] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/users/3703f739dc7b4959a5520ab44eb6f0a3 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:50.069218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:50.089893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.164403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:50.166284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f312023-55af-4dec-9e34-83668c115cac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:50.304903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.308180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a965d16-83f4-4530-a71b-04891ffdc90e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.321590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 84/175] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 08:56:50.322957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e5b-8aba-4e04-a3bd-ad0ae9f4b81f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.323252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e5b-8aba-4e04-a3bd-ad0ae9f4b81f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.323633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa05e5b-8aba-4e04-a3bd-ad0ae9f4b81f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.324969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 85/176] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:50.332844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa05e5b-8aba-4e04-a3bd-ad0ae9f4b81f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:50.384691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.386436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.387074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.388702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.416350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.457894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa05e5b-8aba-4e04-a3bd-ad0ae9f4b81f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.493150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.494016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.494300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.494572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.496466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:50.497927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7317de-0ff3-41a3-9094-8f1e63f0f46d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:50.499842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 86/177] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:50 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:50.501548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.501834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.502114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.516134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:50.517617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:50.537449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:50.539207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:50.643518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 87/178] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:50.644412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:50.704847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.715809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 92/179] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 08:56:50.716706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:50.740379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.770219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb359fb-2f6f-458d-a42e-5352315fd16b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.804647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.805306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.805591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.805869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.806713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:50.807028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:50.808505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:50.814552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 88/180] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:50 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:50.815357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:50.850609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b26e-454d-44e6-a61e-3b03002bcebf None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.889568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.890480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.890768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.891104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.903934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e6a97c17-75ac-4b46-8407-a74eac29047d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:50.912161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:50.913100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:50.914395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 93/181] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:50.915061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ce98-d662-4104-bd6d-e2dd72690888 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.915061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ce98-d662-4104-bd6d-e2dd72690888 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.915405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940ce98-d662-4104-bd6d-e2dd72690888 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.916852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 94/182] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:50.917757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7e0a-c37a-4d6b-befd-df8ad97dd6d5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.918520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7e0a-c37a-4d6b-befd-df8ad97dd6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.918520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a7e0a-c37a-4d6b-befd-df8ad97dd6d5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.919899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 95/183] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:50.925455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbc6-c127-4ca2-b10d-41f70e108727 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.926110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbc6-c127-4ca2-b10d-41f70e108727 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.926588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfdbc6-c127-4ca2-b10d-41f70e108727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.947585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fcbfdbc6-c127-4ca2-b10d-41f70e108727 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:50.950111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fcbfdbc6-c127-4ca2-b10d-41f70e108727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:50.951660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e560e-f107-4eac-8dce-8464dfa01d4c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:50.979288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:50.996484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:50.997711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:50.997711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:50.997891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] PATH_INFO: `/v3/projects/3ae14cfa389a4566baa78e406f0dee4c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:50.999125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=3ae14cfa389a4566baa78e406f0dee4c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.000809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.002505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 89/184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:50 2022] GET /identity/v3/projects/3ae14cfa389a4566baa78e406f0dee4c => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.003103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.019630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.041571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 96/185] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:51.043239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b8846-e83d-433e-84f3-ce5ddbc486a9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.044437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b8846-e83d-433e-84f3-ce5ddbc486a9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.044732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b8846-e83d-433e-84f3-ce5ddbc486a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.063135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-449b8846-e83d-433e-84f3-ce5ddbc486a9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:51.063929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-449b8846-e83d-433e-84f3-ce5ddbc486a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:51.122321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7c95-47f5-4911-9784-a3180fbdcfc8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.134009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 97/186] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:51.135272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8fc-c10c-4372-a330-d08897a57618 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.135561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8fc-c10c-4372-a330-d08897a57618 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.135837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f8fc-c10c-4372-a330-d08897a57618 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.137134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 98/187] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:51.137830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f8fc-c10c-4372-a330-d08897a57618 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.167608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.168298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.168585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.168858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.169606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:51.169915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.171273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.179108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 90/188] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.180447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.234401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.238561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f8fc-c10c-4372-a330-d08897a57618 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.255810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.272646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.273341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.273624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.273902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.274732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=3ae14cfa389a4566baa78e406f0dee4c, user.id=3703f739dc7b4959a5520ab44eb6f0a3) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:51.275045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.276525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23648d-3a30-4df8-ba18-d5eda20ec5c4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.279426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69ca15-40d9-4493-a92d-dcf5d78bf17a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.282198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 99/189] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/role_assignments?user.id=3703f739dc7b4959a5520ab44eb6f0a3&scope.project.id=3ae14cfa389a4566baa78e406f0dee4c&role.id=b0d592c729db4128afedc886fb5dece6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.289939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.289939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.289939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.303218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:51.305097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:51.318160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.318983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.319274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.319557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.331638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:51.339731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:51.340755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:51.341547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 91/190] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:51.342196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.392082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 100/191] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:51.392947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.474480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e255a4-0caf-4d0c-b4c2-cfa00441afcd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.489814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.512842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78deeb8-ab25-425e-ae3d-f67b3a74dba6 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.514662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.515477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.515759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.516145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.526256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:51.527353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:51.534507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:51.535485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 92/192] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:51.536683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.556795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.557675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.557966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.558249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.572469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.573943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.575601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 101/193] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.576387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.645494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cb94a-dd71-40b0-86b8-568b82089e08 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.677636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58c3dd-0849-4a27-b5c2-680bcbafa892 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.686343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.687020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.687318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.687598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.688392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:51.688712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.690097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.698473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 93/194] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.703124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.712108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.712902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.713215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.713488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.714659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.716140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.717755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 102/195] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.718499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.736145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.759240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.800532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4603-e359-444f-b50e-20661a4669e4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.819166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db64aa-8843-412d-ade8-1875d16bac63 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.833560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.834223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.834513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.834791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.836080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:51.836395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.837767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.845605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 94/196] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.849120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:51.853917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.854561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.854843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.855119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.921155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.922542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.943291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.947471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791507-3608-462a-b82c-9028cba5cb95 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:51.959067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:51.982027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:51.982899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:51.983183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:51.983461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] PATH_INFO: `/v3/users/9715cd02fb7b4101b1a53e343423e4e8` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:51.984683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] RBAC: Authorizing `identity:get_user(user_id=9715cd02fb7b4101b1a53e343423e4e8)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:51.986139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:51.987931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 95/197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/users/9715cd02fb7b4101b1a53e343423e4e8 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:51.988546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.028260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 103/198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:52.029117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.091449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad1884-3e91-4372-b60f-0af052a3080a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.124162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.124827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.125111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.125389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.126102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.126549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991d245-3394-4f21-be4f-e72651d392ed None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.127572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.146308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 96/199] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:51 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:52.147121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.173148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.173965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.174248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.174530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.175428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.175810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.177597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.179526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 104/200] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:52.180862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.194157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.265069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7ad25-c244-4d5f-be02-d0369ba99b8f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.302268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c238ddc-8942-4f42-936d-87c27759afd2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.303265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.304177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.304485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.304758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.343152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.344072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.344361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.344638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.345985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.348521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.350448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 105/201] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:52.351984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.390706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.392366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.425381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.449462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.480513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1c25c-faff-43fe-92e2-c067145ef8b8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.512574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 97/202] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:52.513812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.522478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.523181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.523471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.523756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.603487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.605041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.618193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45334a2-8288-4e8b-ad76-67ece2d90630 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.642418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.654870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.655861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.656404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.656877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.657903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=3be9333474044011baaf0fefb909fd41) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:52.658411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.660071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.666630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 98/203] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/role_assignments?user.id=3be9333474044011baaf0fefb909fd41&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:52.667716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.692042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.723245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 106/204] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:52.730057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.781082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949336c-f7ab-40b8-b1e0-09befb8b0508 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.831481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.839978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.839978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.839978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.839978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.839978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.844609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 99/205] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:52.851817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:52.912944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf9ca1-2a39-4d2c-b94d-f39a5844f968 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:52.920342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:52.988614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:52.989407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:52.989692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:52.989969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:52.992717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:52.994174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:52.998365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 107/206] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:53.005770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:53.015243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad585e-3765-4873-a43b-b342d23007cd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:53.087029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:53.087701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:53.088012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:53.088302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:53.089153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd, user.id=9715cd02fb7b4101b1a53e343423e4e8) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:53.089473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:53.090923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecb113-dc50-4930-b3a3-b1b637198bc0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:53.097042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:53.109967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 100/207] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:52 2022] GET /identity/v3/role_assignments?user.id=9715cd02fb7b4101b1a53e343423e4e8&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:53.214826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c6657-e23c-4c9a-b218-6cd114c24f0b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:53.260617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:53.261680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:53.262183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:53.262653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:53.263698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=3be9333474044011baaf0fefb909fd41) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:53.264262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:53.265946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d71c-191c-4f44-8770-f1236c7adb58 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:53.272753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 108/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:53 2022] GET /identity/v3/role_assignments?user.id=3be9333474044011baaf0fefb909fd41&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:54.433131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ae5-9f58-41e9-ac95-7ed9da644c69 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.433673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ae5-9f58-41e9-ac95-7ed9da644c69 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.433673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c5ae5-9f58-41e9-ac95-7ed9da644c69 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.435245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 101/209] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:54.441108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.442014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.442497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.460929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:54.462472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:54.533409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 109/210] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:54.554052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c769-475a-4f8d-9786-98712a559546 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.554917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c769-475a-4f8d-9786-98712a559546 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.555197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c769-475a-4f8d-9786-98712a559546 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.556885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 102/211] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:54.557883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:54.561578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.561868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.562149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.579028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:54.580256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:54.605172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:54.657354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 103/212] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:56:54.675747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd41ae-cdc3-47a5-b40d-2f4c56cf9b20 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:54.682185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:54.711443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:54.712304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.712664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.713022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.723435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:54.732260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:54.734047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:54.736214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 110/213] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:54.737813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:54.743986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:54.798366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd38a-138e-454b-be2c-b34b4c1a21da None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:54.841352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:54.842402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.842684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.843393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.844342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:54.845272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:54.846990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f49ca9-fbd4-4354-a27a-79cab1ea4905 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:54.849844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 104/214] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:54.851843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d21c4-032c-4762-a3e3-a3e01372ac6e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:54.856052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4b87-2266-487f-b279-8fb027beac7a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.856351 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4b87-2266-487f-b279-8fb027beac7a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.856635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4b87-2266-487f-b279-8fb027beac7a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.858067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 105/215] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:54.858626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4b87-2266-487f-b279-8fb027beac7a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:54.890857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:54.891529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.891811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.892124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.892890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:54.893206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:54.894625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc96a6-cf09-4192-820b-165411d9458f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:54.904397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 111/216] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:54.905458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:54.905751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:54.906032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:54.923686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:54.924908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:54.969955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4b87-2266-487f-b279-8fb027beac7a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:54.987710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.000075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 112/217] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:55.000830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.008736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.009408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.009698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.009981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.010711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.012364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.043981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 106/218] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:54 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:55.043981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.116262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.133542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57c77-81db-4bda-a254-f570ce2375dd None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.173463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.175825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.176163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.176453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] PATH_INFO: `/v3/users/371c22992ecd40a39becd8b8e33e173d` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.181834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67e8a-675d-4652-b1d7-ac501f52f530 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.192150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] RBAC: Authorizing `identity:get_user(user_id=371c22992ecd40a39becd8b8e33e173d)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.193623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.197034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 113/219] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:54 2022] GET /identity/v3/users/371c22992ecd40a39becd8b8e33e173d => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:55.201780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.227746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.228418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.228711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.228992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.245790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:55.254713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:55.255807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:55.256709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 107/220] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:55.262444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.305014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.344267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf924f7-9a54-49b2-9d00-5d22897e5718 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.388047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.389222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.390832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.391109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.400355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4b2f-bd48-400c-bfd5-e2c6850a3a5a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.411076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.463710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.465027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.465315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.466012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.467638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:55.468941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.470891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ea33-522f-4c66-a96f-44f484cffa20 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.484527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 108/221] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:55.485885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.486325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437896c6-cc08-4a7f-a176-65847f7fc29c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.486509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437896c6-cc08-4a7f-a176-65847f7fc29c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.486795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437896c6-cc08-4a7f-a176-65847f7fc29c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.488244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 109/222] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:55.488961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf032591-e05b-4411-ac7e-47028c168af7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.492979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437896c6-cc08-4a7f-a176-65847f7fc29c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.613825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.624022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437896c6-cc08-4a7f-a176-65847f7fc29c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.625146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 114/223] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:55.626714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.627007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.627425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.645074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:55.646372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:55.670894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.672082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.672376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.672659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.674518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.676735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.678850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 110/224] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:55.680131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.692340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.721177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 115/225] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:55.722636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.818632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c766e-8eec-45f6-9e38-31b6e752b87c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.854447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331a2b-5c89-40f9-9714-304e4a652e2a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:55.854915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.856070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.856575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.857048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.858447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.860175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.862122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 111/226] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:55.863133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.895330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:55.896320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:55.896504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:55.896788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:55.898030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:55.899490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:55.906250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 116/227] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:55.907127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:55.907943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.958782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:55.970900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9999b-99d4-49c4-a5d9-64a0574ec25a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.006902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.008117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.008586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.009032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.017263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f754ef-8a03-4580-a274-190607050f43 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.020958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:56.029613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:56.030533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:56:56.031328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:56.033669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 112/228] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:56.034615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:56.056976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.057757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.058117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.058471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.059399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=371c22992ecd40a39becd8b8e33e173d) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:56.059800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.061367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.076341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 117/229] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:55 2022] GET /identity/v3/role_assignments?user.id=371c22992ecd40a39becd8b8e33e173d&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=b0d592c729db4128afedc886fb5dece6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:56.077398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:56.140175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:56.147688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b1628-e3a7-4be5-a626-6f388fb0673f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.191119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592b07-a016-4b22-bab7-945198dddae3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.201282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:56.220763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.221975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.222411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.222832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/3be9333474044011baaf0fefb909fd41/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.225124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, user_id=3be9333474044011baaf0fefb909fd41, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.227266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.229103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.229971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.230273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.230665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.231565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:56.237998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.237998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.243014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 118/230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:56:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:56.248952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:56.258692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 113/231] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:56 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/3be9333474044011baaf0fefb909fd41/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:56.404787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493af96-ab34-456b-98b1-5f7a815f321b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.455679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.456934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.457404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.457964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.459532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.461853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 119/232] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:56 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:56.469845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:56.578631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a266-f95d-4247-b2d9-d6282bbc1433 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.615203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.616102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.616395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.616704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.617915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.619363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048d0b1-2826-4765-a1ba-a8f3ecd5bc06 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.621427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 114/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:56 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:56.626946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:56.682418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:56.768961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de6265-0c11-46bb-a454-9eb1f8f1eed0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:56.811515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:56.812443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:56.812733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:56.813015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/3be9333474044011baaf0fefb909fd41/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:56.815362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, user_id=3be9333474044011baaf0fefb909fd41, role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:56.817131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81559ae-bd08-44af-a54e-8359807c7f79 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:56.834741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 120/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:56 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/3be9333474044011baaf0fefb909fd41/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:56:57.454019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4589f-42b3-4872-bf6c-e31c10aa7bd7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.454427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4589f-42b3-4872-bf6c-e31c10aa7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.454615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4589f-42b3-4872-bf6c-e31c10aa7bd7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.456146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 115/235] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:57.461499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d717-9c2b-4574-bd68-8c8c8c3796f5 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.461802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d717-9c2b-4574-bd68-8c8c8c3796f5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.462095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d717-9c2b-4574-bd68-8c8c8c3796f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.488994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f158d717-9c2b-4574-bd68-8c8c8c3796f5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:57.490216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f158d717-9c2b-4574-bd68-8c8c8c3796f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:57.571158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 121/236] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:57.594357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4589f-42b3-4872-bf6c-e31c10aa7bd7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:57.615530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:57.697734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a8df-7dc0-4604-87dd-fcc4e46ec704 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.698240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a8df-7dc0-4604-87dd-fcc4e46ec704 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.698341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a8df-7dc0-4604-87dd-fcc4e46ec704 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.699863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 122/237] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:56:57.704614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.705127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.705599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.712101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4589f-42b3-4872-bf6c-e31c10aa7bd7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:57.753150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:57.754725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:57.758003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:57.758807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.759095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.759373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.779845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:57.796622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:57.797510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:56:57.798294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:57.799661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 116/238] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:56:57.805572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:57.805713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:57.898084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:57.917720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 123/239] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:57.918424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f01d0d-ae58-4c52-9106-7e23a40af6cc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:57.953097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:57.953774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:57.954066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:57.954354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:57.955168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:57.955503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:57.957363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:57.958564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:57.966610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 117/240] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:57.971804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.074354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98838-f009-40c2-b3ed-c1177e73cfee None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:58.117613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:58.118495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.118786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.119064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] PATH_INFO: `/v3/users/99d22c82517a46cf831d24cc9a778a29` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.137344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:58.144326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] RBAC: Authorizing `identity:get_user(user_id=99d22c82517a46cf831d24cc9a778a29)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:58.145826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:58.147554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 118/241] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:57 2022] GET /identity/v3/users/99d22c82517a46cf831d24cc9a778a29 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:58.157313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.236400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea124f-2bcb-4c57-8b52-ba9524ad9065 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:58.305547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:58.306369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.307197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.307197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.308785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:58.310368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:58.312041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 124/242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:56:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:58.318963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.351607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c556-0dbb-45c8-b232-1513cd4519b9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:58.376348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:58.426564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:58.427274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.427566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.427846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.499371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:58.500603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:58.502309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:58.605530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 119/243] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:56:58.606071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e330c6e-c975-4f95-bcb3-ab288c66416b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:58.611683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.677257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:58.677939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.678220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.678496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.679757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:58.683450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2715bd-63ce-4d45-9216-efeb7265fdde None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:58.728611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 125/244] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:56:58 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:56:58.730669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a44c-b6aa-494b-b775-e8a8e956a114 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.731111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a44c-b6aa-494b-b775-e8a8e956a114 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.731570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a44c-b6aa-494b-b775-e8a8e956a114 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.733505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 126/245] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:58.742195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.742753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.743239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.764913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:58.767275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:58.806734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:58.812393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131a7b-8990-462c-8561-b3011792203f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:58.856015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 127/246] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:58.883946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:58.884855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:58.885146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:58.885429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:58.886682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:58.888193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:58.890226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 120/247] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:58 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:58.891393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.896306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:58.910904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.012493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faa40f-ef95-46ce-af77-3c58afc6b803 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.031407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ad60-20fd-4b87-9269-c77dec2f87c5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.055175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.056078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.056370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.056649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.070926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e4e2d264-88ea-4ab8-a61b-10ca471e3ee6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:59.078840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:59.080063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:56:59.081058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 128/248] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:59.081830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05b88-d9bf-463a-a379-a3646267cc4c None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.081830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05b88-d9bf-463a-a379-a3646267cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.081947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e05b88-d9bf-463a-a379-a3646267cc4c None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.083798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 129/249] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:59.084701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.085410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.085701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.085980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.086826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=99d22c82517a46cf831d24cc9a778a29) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:59.087143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:59.088574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05b88-d9bf-463a-a379-a3646267cc4c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.088802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee418-5f28-4e94-b854-dd8d575018ce None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:59.099372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 121/250] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:56:58 2022] GET /identity/v3/role_assignments?user.id=99d22c82517a46cf831d24cc9a778a29&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:59.100503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.100639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.101620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.122819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:59.124085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:59.161430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.202181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.234610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 122/251] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:59.247474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e05b88-d9bf-463a-a379-a3646267cc4c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.262661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.294836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.295515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.295906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.296311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.297152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:59.297531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:59.299221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:59.311366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 130/252] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:59.317904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.389505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc777168-969f-4d93-8048-1e7b64c54526 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.438972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facedf-a263-46d8-882b-7d8f5aab692e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.458852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.459839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.460215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.460604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.487976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:56:59.488936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.490028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.490490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.490941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] PATH_INFO: `/v3/users/371c22992ecd40a39becd8b8e33e173d` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.493017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=371c22992ecd40a39becd8b8e33e173d)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:59.494675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98362b6c-b0f3-4365-81cb-713455dfb7b7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:59.497575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 131/253] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/users/371c22992ecd40a39becd8b8e33e173d => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:56:59.498961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81154-87dc-4bfa-9332-6443806d540e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.499425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81154-87dc-4bfa-9332-6443806d540e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.499879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da81154-87dc-4bfa-9332-6443806d540e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.501343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 132/254] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-23d7393f-692e-464c-83ef-cfee42c4306a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:56:59.501643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:56:59.502488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:56:59.503287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:56:59.505790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81154-87dc-4bfa-9332-6443806d540e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.506901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 123/255] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:56:59.509293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.510135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.511764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.514206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.548034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:56:59.549314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:56:59.585562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.671788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 124/256] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:56:59.672778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.677400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da81154-87dc-4bfa-9332-6443806d540e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.747651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.748552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.748834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.751994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.753351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:59.755018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:59.757485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 133/257] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:59.758413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.847768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c94be6-16e0-46d1-87a9-310eb8255131 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:56:59.896106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.896297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:56:59.896297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:56:59.896297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:56:59.896297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:56:59.896592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:56:59.896592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:56:59.896592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:56:59.906131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 125/258] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:56:59.907150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:56:59.922861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:56:59.954883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbe33d-5ef1-41b6-b49a-4ec4c40fa09e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.015820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989313-5cc6-42d4-a0f1-60048e95c262 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.053256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.054571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.054858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.055138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/371c22992ecd40a39becd8b8e33e173d/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.057961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, user_id=371c22992ecd40a39becd8b8e33e173d, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:00.059431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:00.060686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.061534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.061827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.062114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.074437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:00.080882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 126/259] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:56:59 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/371c22992ecd40a39becd8b8e33e173d/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:00.081784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:00.086807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:00.087736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:00.088565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 134/260] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:00.103698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.248964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:00.287345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1cca-ef02-47d3-90b6-61e474122d75 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.327741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.328679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.328966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.329248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.331605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:00.333096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:00.334780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 127/261] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:00.340949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.356761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416627d-1f20-4c2a-a80c-239a711511c9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.423706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:00.430230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.430915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.431258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.431548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.432671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:00.432992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:00.435530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:00.455092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 135/262] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:00.461173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.526140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff117-6c53-4922-b7fb-2562f34ec544 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.564273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.564946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.565232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.565508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.578368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:00.652127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:00.653532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:00.674817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5b55-6878-4f9c-a2df-116a86c7f18b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.726736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.727677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.727982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.728270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] PATH_INFO: `/v3/users/3be9333474044011baaf0fefb909fd41` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:00.729544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] RBAC: Authorizing `identity:get_user(user_id=3be9333474044011baaf0fefb909fd41)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:00.732761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:00.734461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 136/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/users/3be9333474044011baaf0fefb909fd41 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:00.740193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.822085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 128/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:00.829046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:00.841890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:00.907826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e9055-98b0-4dbe-8901-483270f7f385 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:00.917161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:00.957656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:00.958313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:00.958599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:00.958881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.039451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfa6d-9948-4b2a-8c89-808c834c5260 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:01.073008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:01.074690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:01.081281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:01.082152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.082433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.082708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.089568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:01.091021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:01.095426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 129/265] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:01.121755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:01.192558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:01.297251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 137/266] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:01.302953 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:01.354135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552d10-8944-4a06-be33-f480324fb849 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:01.379784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:01.453743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:01.454752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.455238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.455713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.456780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=3be9333474044011baaf0fefb909fd41) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:01.457297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:01.459003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:01.466030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a53d4-b216-4079-89e9-bbff00b89934 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:01.469890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 130/267] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:01 2022] GET /identity/v3/role_assignments?user.id=3be9333474044011baaf0fefb909fd41&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:01.504228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:01.505107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.505391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.505669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.506923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:01.509371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d189bb6-0e3b-4107-a80e-0398fb3f23c0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:01.511401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 138/268] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:01 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:01.517596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:01.668485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca691e39-44cf-43af-868c-bbda97f367b0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:01.716949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:01.717586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.717878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.718157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.719100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=3be9333474044011baaf0fefb909fd41) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:01.719415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:01.720902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888047bd-eee4-4c58-9864-2e65dec4b3b9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:01.728681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 131/269] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:01 2022] GET /identity/v3/role_assignments?user.id=3be9333474044011baaf0fefb909fd41&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:01.979281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b30f3-fbb6-459a-b672-69ba84fe209e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.979902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b30f3-fbb6-459a-b672-69ba84fe209e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.979902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b30f3-fbb6-459a-b672-69ba84fe209e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:01.981165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 139/270] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:01.986590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d97c-cb9f-4d82-822f-2e94962d2f07 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:01.987033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d97c-cb9f-4d82-822f-2e94962d2f07 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:01.987142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d97c-cb9f-4d82-822f-2e94962d2f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.017211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-af12d97c-cb9f-4d82-822f-2e94962d2f07 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:02.018745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af12d97c-cb9f-4d82-822f-2e94962d2f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:02.056356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.056716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b4f-5b72-43f6-b9b1-59d036b49263 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.057860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b4f-5b72-43f6-b9b1-59d036b49263 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.058472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f709b4f-5b72-43f6-b9b1-59d036b49263 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.060258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 140/271] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:02.066537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.067060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.067577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.093642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:02.095194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:02.107655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 132/272] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:02.123675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.124998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1003-179e-4fde-a29b-c6da347306f3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.125461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1003-179e-4fde-a29b-c6da347306f3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.125891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1003-179e-4fde-a29b-c6da347306f3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.127682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 133/273] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:02.136108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.136608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.137035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.156180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:02.158219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:02.185081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 141/274] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:02.186373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.253952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 134/275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:02.255202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.316385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4b16-139f-414c-9c1a-7c0ebaac61c9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.352430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.353224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.353507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.353828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.355182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:02.356437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.356824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:02.358613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 142/276] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:02.359426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.365418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19893c38-7e95-4807-8958-e5e5cc734e0f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.391941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.404173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.404981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.405267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.405544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.416410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:02.424923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:02.425796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:02.426600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 135/277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:02.427244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.474955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13e692-af0a-4472-b377-e6c587354bff None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.510119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.510838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.511126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.511408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.522073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:02.530026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:02.530932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:02.531733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 143/278] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:02.532438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.540222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772543c-4e67-470e-be9b-befe0c15e6b8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.581527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.582744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.583162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.583495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.587008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:02.587008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:02.623981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 136/279] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:02 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:02.623981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.636207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.638153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.668416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17bcb3-1581-4f0d-9c18-2a1862bce0ef None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.708242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.708991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.709283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.709564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.710442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:02.710764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:02.712336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:02.723804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 144/280] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:02.730156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.765869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d4577-a2f0-4520-923a-bd5b5ebfa0ff None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.810479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.811154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.811443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.811720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.812511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:02.812824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:02.814242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:02.825226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 137/281] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:02.830489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.841332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f11f-7b08-4bbc-bba3-2236cb464cc2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:02.886796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:02.887836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:02.888225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:02.888511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] PATH_INFO: `/v3/users/99d22c82517a46cf831d24cc9a778a29` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:02.890193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=99d22c82517a46cf831d24cc9a778a29)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:02.891927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:02.894427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 145/282] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/users/99d22c82517a46cf831d24cc9a778a29 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:02.899899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:02.923112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.939713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:02.972498 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3125bf-583b-4a15-867a-d2eb9c9bf513 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.015408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.016380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.016609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.016885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] PATH_INFO: `/v3/users/f5451a4ea0a34e95a844479cc89fd0fe` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.031357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] RBAC: Authorizing `identity:get_user(user_id=f5451a4ea0a34e95a844479cc89fd0fe)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.033000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cc425-2d86-41ca-a36e-6e25e5b90de7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.034910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234c913-ac7d-4b77-b43e-04f100bf5ed4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.035343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 138/283] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/users/f5451a4ea0a34e95a844479cc89fd0fe => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:03.036416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea215a-a1de-410e-aa12-a93411d12bb5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.036701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea215a-a1de-410e-aa12-a93411d12bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.036979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea215a-a1de-410e-aa12-a93411d12bb5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.042893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 139/284] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:03.043712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea215a-a1de-410e-aa12-a93411d12bb5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.073007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.074209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.074730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.075143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.076608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.078322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406f5e1-9c2a-4bb2-89d4-a227f4341fbd None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.080718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 146/285] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:02 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:03.082109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.082539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.082958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.101498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:03.102933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:03.153891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea215a-a1de-410e-aa12-a93411d12bb5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.174769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 147/286] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:03.175884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.192748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:03.196439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:03.209521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.210771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.211062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.211337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.212311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, user.id=f5451a4ea0a34e95a844479cc89fd0fe, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:03.212645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.214163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.225065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 140/287] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 23 08:57:03 2022] GET /identity/v3/role_assignments?user.id=f5451a4ea0a34e95a844479cc89fd0fe&scope.system=all&role.id=b0d592c729db4128afedc886fb5dece6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:03.226664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.304739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e746cb1-86fc-44ac-82da-76d82ca13973 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.360911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.363790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.364369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.364829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/99d22c82517a46cf831d24cc9a778a29/roles/db8ceda7dbe94858ba593290baefcca3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.367291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, user_id=99d22c82517a46cf831d24cc9a778a29, role_id=db8ceda7dbe94858ba593290baefcca3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.368998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.390173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892480aa-0b5e-47c8-9572-47035d4d868d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.390569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 148/288] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:03 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/users/99d22c82517a46cf831d24cc9a778a29/roles/db8ceda7dbe94858ba593290baefcca3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:03.439379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.440362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.440912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.441241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.455300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:03.464478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:03.465435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:03.466224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 141/289] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:03.471964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.550523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:03.579794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f652d62-d816-4e79-a01a-b8cf90a76d25 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.619045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.620147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.620608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.621063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.622021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:03.622539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.624149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.638121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 149/290] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:03.639841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.709787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:03.757007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c860e1-b49c-48ca-a292-306152d7f07f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:03.795980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:03.796863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:03.797143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:03.797420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] PATH_INFO: `/v3/users/371c22992ecd40a39becd8b8e33e173d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:03.801886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] RBAC: Authorizing `identity:get_user(user_id=371c22992ecd40a39becd8b8e33e173d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:03.803456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:03.805206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 142/291] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:03 2022] GET /identity/v3/users/371c22992ecd40a39becd8b8e33e173d => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:03.811046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:03.961476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805805af-7f77-4d42-a020-da10d8377493 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:04.002373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:04.003369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:04.003850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:04.004344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:04.008242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:04.096230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:04.097700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:04.212873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 150/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:04.215988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:04.333837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312adf-b1cf-4dd0-b81a-ebeb00997e06 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:04.362938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:04.380784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:04.381655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:04.381939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:04.382768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:04.388704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:04.390223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af874-8d99-4bf0-abb8-f33497700242 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:04.392039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 143/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:04 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:04.398929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:04.472985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:04.551083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a48c9e-700e-49c2-92cb-ddebf0e4c81e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:04.588063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:04.588737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:04.589026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:04.589309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:04.590157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=371c22992ecd40a39becd8b8e33e173d) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:04.590478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:04.596102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac02e89-1dad-4703-a999-d64d529e6400 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:04.598839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 151/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:04 2022] GET /identity/v3/role_assignments?user.id=371c22992ecd40a39becd8b8e33e173d&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=b0d592c729db4128afedc886fb5dece6 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:05.395766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4599b-9fdf-4fd4-8ccc-4dad12aeac2f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.396328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4599b-9fdf-4fd4-8ccc-4dad12aeac2f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.396328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4599b-9fdf-4fd4-8ccc-4dad12aeac2f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.398549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 144/295] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:05.403482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939580-bce7-4c34-8ac4-1040a806cada None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.404329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939580-bce7-4c34-8ac4-1040a806cada None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.404840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f939580-bce7-4c34-8ac4-1040a806cada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.422756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6f939580-bce7-4c34-8ac4-1040a806cada None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:05.424352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6f939580-bce7-4c34-8ac4-1040a806cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:05.508199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 152/296] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:05.518391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095cf3-2ec3-43a2-8d4e-348269182d0a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.518686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095cf3-2ec3-43a2-8d4e-348269182d0a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.518968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3095cf3-2ec3-43a2-8d4e-348269182d0a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.520519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 145/297] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:05.526195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.526489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.526773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.533435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3095cf3-2ec3-43a2-8d4e-348269182d0a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:05.544483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:05.545701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:05.570300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:05.621940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 153/298] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:05.645414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:05.682063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3095cf3-2ec3-43a2-8d4e-348269182d0a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:05.719102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:05.719903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.720220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.720499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.731678 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-18c27085-2754-4422-b8fb-5c02a9537e2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:05.740116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:05.741033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 146/299] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:05.746140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cec4a-33b6-4503-a456-2d87d20434fd None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.746905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cec4a-33b6-4503-a456-2d87d20434fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.746905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cec4a-33b6-4503-a456-2d87d20434fd None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.746905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 147/300] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:05.749926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.750272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.750552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.763766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fab572-8e41-4eee-b26c-f2044baacb24 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:05.767997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:05.769432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:05.808830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:05.809887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:05.811093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:05.811378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:05.812652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:05.814169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:05.817745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 154/301] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:05.817889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:05.833971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:05.851742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:05.873025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 148/302] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:05.874528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:05.979306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318433f8-8d42-47cd-9176-a1c6431919a3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.032590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942ef4e-0626-4984-9914-0a09ed9dc96e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.038778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.039926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.040441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.040919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.042296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:06.042826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.045418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.065280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 155/303] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.065280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.084873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.085785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.086078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.086363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] PATH_INFO: `/v3/groups` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.087271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.088859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.115991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 149/304] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jun 23 08:57:05 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:06.115991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.185416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.214440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.225438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e0df-90ec-4267-96a5-33746d77f204 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.263171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab98a-d873-40fb-817b-082ae972b424 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.270595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.271984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.272284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.272567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.284845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-cdd3a2a3-18ce-4fb1-b4e2-0a8603cac347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:06.293566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:06.295415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 156/305] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:06.298256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94877c-b8f2-4389-a634-f6d422e15520 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.299050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94877c-b8f2-4389-a634-f6d422e15520 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.299050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94877c-b8f2-4389-a634-f6d422e15520 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.299050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 157/306] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:06.303687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94877c-b8f2-4389-a634-f6d422e15520 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.308156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.310467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.310757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.311433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] PATH_INFO: `/v3/users/adae8298ffab4d39adc941c73b4200f7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.328625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] RBAC: Authorizing `identity:get_user(user_id=adae8298ffab4d39adc941c73b4200f7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.330096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7dd25-58f0-4270-aa53-f48a9465a692 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.331858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/users/adae8298ffab4d39adc941c73b4200f7 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.333136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.333426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.333715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.355566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:06.356816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:06.416952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94877c-b8f2-4389-a634-f6d422e15520 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.439975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 151/308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:06.439975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.453566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.454598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.454936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.455219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.456197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:06.456517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.458325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.467249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 158/309] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.467920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.479038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.484581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.552624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18827-bf60-4881-a6e0-e3235592b332 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.575797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ced5c-0a35-49be-940b-b76e5d032a47 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.593268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.593931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.594216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.594492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.595371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, user.id=adae8298ffab4d39adc941c73b4200f7, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:06.595691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.597175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.603030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 152/310] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/role_assignments?user.id=adae8298ffab4d39adc941c73b4200f7&scope.system=all&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.603845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.632411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.633248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.633534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.633876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.647522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:06.656363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:06.657320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:06.658110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 159/311] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:06.665266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.735726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.745061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9390-3c76-4790-bdad-d5fcfa246a3c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.749870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:06.785900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e5ad-e98d-40a9-9705-1331cab3f8aa None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.789116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.790156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.790393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.790671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] PATH_INFO: `/v3/users/f5451a4ea0a34e95a844479cc89fd0fe` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.791893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] RBAC: Authorizing `identity:get_user(user_id=f5451a4ea0a34e95a844479cc89fd0fe)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.793366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.795178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 153/312] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/users/f5451a4ea0a34e95a844479cc89fd0fe => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.802407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.834550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.836723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.837444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.837896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.838821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:06.839545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.841996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.857479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 160/313] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:06.858649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:06.920647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5ed9b-640a-4cac-8f11-a8e974f89a3a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:06.958131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:06.959017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:06.959284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:06.959563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] PATH_INFO: `/v3/system/users/f5451a4ea0a34e95a844479cc89fd0fe/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:06.961648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5451a4ea0a34e95a844479cc89fd0fe, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:06.963160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:06.980932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 154/314] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jun 23 08:57:06 2022] PUT /identity/v3/system/users/f5451a4ea0a34e95a844479cc89fd0fe/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 08:57:06.994456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f347dd-8e1e-4f08-a240-b78803f63b21 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:07.035609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:07.036912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:07.037398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:07.037891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] PATH_INFO: `/v3/users/99d22c82517a46cf831d24cc9a778a29` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:07.040093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] RBAC: Authorizing `identity:get_user(user_id=99d22c82517a46cf831d24cc9a778a29)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:07.041983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:07.044048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 161/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:06 2022] GET /identity/v3/users/99d22c82517a46cf831d24cc9a778a29 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:07.049941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:07.093647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:07.173305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383836f-1181-429e-a7f9-4cef89499253 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:07.211250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:07.211904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:07.212218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:07.212497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:07.288899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:07.290405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:07.320916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:07.395433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 155/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:07.401233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:07.404373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:07.515404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853e56-441f-4f4f-8dec-a639139c0336 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:07.549891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:07.550762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:07.551050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:07.551335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:07.552579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:07.554625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77d5b2-5ce1-4fa5-a393-0d3da01fce81 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:07.556391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 162/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:07 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:07.562119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:07.670049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738d648-0a7c-4d50-8ee6-bd6c597cb32f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:07.704760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:07.708719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:07.709386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:07.709676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:07.709960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:07.711335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a, user.id=99d22c82517a46cf831d24cc9a778a29) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:07.712030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:07.713806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90d7f4-7e55-4a71-937b-a9ea284dc5b9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:07.720652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 156/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:07 2022] GET /identity/v3/role_assignments?user.id=99d22c82517a46cf831d24cc9a778a29&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:08.248105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33699-c437-4da9-af0d-71444ee23e78 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.248497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33699-c437-4da9-af0d-71444ee23e78 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.248676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f33699-c437-4da9-af0d-71444ee23e78 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.250222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 163/319] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:08.255242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.255544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.255831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.273106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:08.274300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:08.344905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 157/320] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:08.367525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33699-c437-4da9-af0d-71444ee23e78 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:08.441588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:08.475739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f33699-c437-4da9-af0d-71444ee23e78 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:08.510347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:08.511147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.511432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.511711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.512907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:08.514354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14aed-fc50-4568-9a44-9fc8769b6218 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:08.516166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 164/321] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:08.521396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:08.646096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381636f2-a7eb-4f83-a164-1eddbda2b791 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:08.667853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:08.683341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:08.684032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.684321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.684600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] PATH_INFO: `/v3/groups` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.685324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:08.686758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0b853-d03e-445a-8778-e73343c28847 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:08.701272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 158/322] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jun 23 08:57:08 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:08.762265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054873c-5169-4395-a55d-5fab4fa62d47 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.762554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054873c-5169-4395-a55d-5fab4fa62d47 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.762740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054873c-5169-4395-a55d-5fab4fa62d47 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.764384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 165/323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:08.769905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:08.770205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:08.770487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:08.788173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:08.789966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:08.865790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 159/324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:08.887826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054873c-5169-4395-a55d-5fab4fa62d47 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:08.996127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054873c-5169-4395-a55d-5fab4fa62d47 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:09.031928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:09.032686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.032968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.033242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.041166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:09.045494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:09.054171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:09.055270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:09.056285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:09.058876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 166/325] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:09.065091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:09.186274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155069-9251-4aee-b357-6cc87982dfb1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:09.198479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:09.232505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:09.233192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.233475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.233750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.234511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:09.234820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:09.236215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:09.246226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 160/326] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:09.252271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:09.378115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca311b-5949-4929-a23c-6044d7b427bb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:09.421902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:09.422784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.423067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.423347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] PATH_INFO: `/v3/users/adae8298ffab4d39adc941c73b4200f7` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.424658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] RBAC: Authorizing `identity:get_user(user_id=adae8298ffab4d39adc941c73b4200f7)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:09.426122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723688c-a3d9-4464-b090-93ccbb75f549 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:09.428088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 167/327] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:09 2022] GET /identity/v3/users/adae8298ffab4d39adc941c73b4200f7 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:09.433503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:09.547887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e400-dfa4-492c-90db-bec106b17276 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.548419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e400-dfa4-492c-90db-bec106b17276 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.548493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e400-dfa4-492c-90db-bec106b17276 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.550137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 168/328] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:09.555517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.555810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.556121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.563525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c3ea-e75a-4a49-896c-fe625b0b0cca None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:09.586321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:09.587670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:09.624679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:09.625558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.625906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.626191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] PATH_INFO: `/v3/system/users/adae8298ffab4d39adc941c73b4200f7/roles/db8ceda7dbe94858ba593290baefcca3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.627932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=adae8298ffab4d39adc941c73b4200f7, role_id=db8ceda7dbe94858ba593290baefcca3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:09.629496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:09.656331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 161/329] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jun 23 08:57:09 2022] PUT /identity/v3/system/users/adae8298ffab4d39adc941c73b4200f7/roles/db8ceda7dbe94858ba593290baefcca3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:09.675653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 169/330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:09.676340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:09.708540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:09.773146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:09.874604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c4173-54eb-4703-b490-e81952d89292 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:09.914078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:09.915095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:09.915538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:09.915998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:09.929604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:09.937639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:09.938707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:09.939621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:09.942367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 162/331] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:09.948302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:10.077496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaac9ef-7272-49d3-819c-6a8420478ace None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:10.117365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:10.118047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:10.118334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:10.118615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:10.119378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:10.119692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:10.121141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:10.130482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 170/332] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:10.136263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:10.243440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:10.250423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843df5-6aba-43f3-91df-2099d985fbae None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:10.285477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:10.286354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:10.286641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:10.286921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] PATH_INFO: `/v3/users/f5451a4ea0a34e95a844479cc89fd0fe` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:10.289696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] RBAC: Authorizing `identity:get_user(user_id=f5451a4ea0a34e95a844479cc89fd0fe)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:10.290164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09175b4-7072-44b5-90ba-c472a322dfac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:10.292171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 163/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:10 2022] GET /identity/v3/users/f5451a4ea0a34e95a844479cc89fd0fe => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:10.301127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:10.382318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:10.441864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ce557-093e-4450-a9be-0a66985be89a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:10.482757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:10.483433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:10.483721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:10.484031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:10.484889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] RBAC: Adding query filter params (role.id=b0d592c729db4128afedc886fb5dece6, user.id=f5451a4ea0a34e95a844479cc89fd0fe, scope.system=all) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:10.485207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:10.486656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437f294-2c62-47de-b355-e4e2f5941dc7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:10.503058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 171/334] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 23 08:57:10 2022] GET /identity/v3/role_assignments?user.id=f5451a4ea0a34e95a844479cc89fd0fe&scope.system=all&role.id=b0d592c729db4128afedc886fb5dece6 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:11.912919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3da2-a7e9-496f-be69-05ed60a81a6e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:11.914319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3da2-a7e9-496f-be69-05ed60a81a6e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:11.914764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3da2-a7e9-496f-be69-05ed60a81a6e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:11.916559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 164/335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:11.922081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:11.922854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:11.923310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:11.942338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:11.943845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:12.006252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a9c1-e3d9-4b3d-9c9d-f2a29cf182da None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.006866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a9c1-e3d9-4b3d-9c9d-f2a29cf182da None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.007381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6a9c1-e3d9-4b3d-9c9d-f2a29cf182da None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.012870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 165/336] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:12.014541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.015026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.015506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.022294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 172/337] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:12.037087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:12.039648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:12.060479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.120068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 166/338] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:12.136353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:12.149515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.216626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f1f8-2634-4435-beb6-30aa1c73e8a1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:12.268691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:12.269514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.269804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.270089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.285803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-dac1b5d9-549b-476a-83b7-5f18ae16f177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:12.306626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:12.307555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:12.308388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 173/339] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:12.309538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc2926-5656-450a-a1a1-2d0254bc5272 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.309999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc2926-5656-450a-a1a1-2d0254bc5272 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.310424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc2926-5656-450a-a1a1-2d0254bc5272 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.311841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 174/340] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:12.317964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc2926-5656-450a-a1a1-2d0254bc5272 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.384731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f3d45-a651-4ba4-bee2-7cc9082271f6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:12.400332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:12.428044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:12.429083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.429500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.430731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.442553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b50cd20b-7ab4-4066-a25c-6498ae042a83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:12.451844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:12.452739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:12.453531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:12.456314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 167/341] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:12.457797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.458306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.458794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.477417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:12.478965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:12.555764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc2926-5656-450a-a1a1-2d0254bc5272 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:12.568632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 168/342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:12.570210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.572137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:12.628938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:12.630851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.631305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.632964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.633872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:12.634327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:12.636428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:12.655534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 175/343] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:12.657793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.744435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:12.756166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20d6c9-6fa7-4c1e-8f80-389feae60674 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:12.791084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166cda0-8dd1-4f3b-bf48-918d58c98afc None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:12.802702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:12.804375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.804663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.805214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.805981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:12.806550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:12.808705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:12.820905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 169/344] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:12.821980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.832352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:12.833198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.833533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.833816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.846856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-6832b155-30c7-49b4-b60f-827af5ab1478 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:12.858186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:12.859108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:12.859940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 176/345] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:12.860648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdd3a-2ae1-4f6a-b3a4-9624e328032e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:12.861298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdd3a-2ae1-4f6a-b3a4-9624e328032e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:12.861298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bdd3a-2ae1-4f6a-b3a4-9624e328032e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:12.862724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 177/346] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:12.863433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bdd3a-2ae1-4f6a-b3a4-9624e328032e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:12.898963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:12.958750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f96ba5-e3b3-4f08-b29c-173b7fad362d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.003611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.004301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.004586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.004861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.006703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bdd3a-2ae1-4f6a-b3a4-9624e328032e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.024536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.054671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.055567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.056038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.056850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.085944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.087398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4fabf-0f29-47b3-9b5a-6fbfdfccf8cc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.145241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.146964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.178335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.209268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 170/347] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:13.215101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017838-fe84-4df5-b4c3-852f7b6cc8cf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.215478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017838-fe84-4df5-b4c3-852f7b6cc8cf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.215761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68017838-fe84-4df5-b4c3-852f7b6cc8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.234531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-68017838-fe84-4df5-b4c3-852f7b6cc8cf None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:13.235850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-68017838-fe84-4df5-b4c3-852f7b6cc8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:13.267529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 178/348] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:13.268433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.296425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.326648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 171/349] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:13.326648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458f31-b753-45d0-8f5b-87607ff5ef95 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.326648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458f31-b753-45d0-8f5b-87607ff5ef95 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.326648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1458f31-b753-45d0-8f5b-87607ff5ef95 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.327646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 172/350] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:13.328383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458f31-b753-45d0-8f5b-87607ff5ef95 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.399146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41580-77e8-427e-a280-eda1d1f327c2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.433690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.444726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.445890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.446526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.446805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.447572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:13.447883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.449935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.460536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1458f31-b753-45d0-8f5b-87607ff5ef95 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.460708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 179/351] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:13.461373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.514385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.514385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.514385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.514385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.515035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.516435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad7d15-050d-4a08-b819-bad942bb0c5d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.518232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 173/352] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:13.520571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.520855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.521129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.540829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:13.540829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:13.595749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.604325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75fb6f-670a-45fa-a60b-4413480e1481 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.632197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 174/353] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:13.633641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.645697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.647067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.647455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.648436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.650032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.652375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.656045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 180/354] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:13.657046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.735051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.759903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cbca8-0c6f-4c5b-8047-cb62fa974cf1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.794956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449400ee-68ef-4f29-81b6-8d9fd112c078 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.800750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.801730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.802229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.802508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.815326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:13.824021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:13.825147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:13.826168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 175/355] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:13.826970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:13.834907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.834907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.834907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.835726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.864935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.916725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:13.918251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:13.946695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf72d-9f5f-4f34-af74-f70ffa5f43d6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:13.983595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:13.988681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:13.989551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:13.989837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:13.990121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:13.998553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.000046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.001908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 176/356] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.002525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.038931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 181/357] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:14.039784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.118650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.122655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668bac9-7ffc-4aef-84b7-631b30005115 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.157682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1714f0-ff21-4b0d-80b4-55b1b50812c5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.166904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.167773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.168095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.168373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.169556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.170996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1aaed-d73b-4c3b-b5e1-aed04f2e6d1c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.172738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 177/358] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.176290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9e45-b62b-476a-866a-e87904968b22 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.176290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9e45-b62b-476a-866a-e87904968b22 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.176290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9e45-b62b-476a-866a-e87904968b22 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.176290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 178/359] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:14.177097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9e45-b62b-476a-866a-e87904968b22 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.209559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.209559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.209559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.209559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.220534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:14.228809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:14.229733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:14.230663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 182/360] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:14.231327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.253917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.296152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9e45-b62b-476a-866a-e87904968b22 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.333942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.334615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.334906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.335221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.336041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:14.336323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.337705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.347328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 179/361] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.348615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.352374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593cc38-e0aa-4c8a-a309-3668efdad045 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.379524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.396100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.396768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.397059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.397346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.398249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:14.398569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.400054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.408807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 183/362] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=b0d592c729db4128afedc886fb5dece6 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.409631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.483196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc30ab4-27e7-46ca-9aa6-37add779a89c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.533815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.534736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.535249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.535590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.535881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.538010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.539577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee98141-0dbc-4f0f-a8a0-d562b7161d97 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.541550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 180/363] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.542769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.543058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.543334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.556001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c72-8859-4152-837a-711133b2ac1b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.562732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:14.563945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:14.603273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.603946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.604266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.604552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.605414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:14.605738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.607200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.615038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 184/364] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=b0d592c729db4128afedc886fb5dece6 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.615940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.647838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 181/365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:14.648758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.680702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.760694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a67e-ef3b-4f03-bfd4-2db2b3374def None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.792814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb40b6-0fc5-4c67-8273-5fb774045df1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.811117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.812602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.813364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.813854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.814992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:14.816078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.817702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.828441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 185/366] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.828724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.839669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.840604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.840891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.841167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] PATH_INFO: `/v3/users/adae8298ffab4d39adc941c73b4200f7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.842402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] RBAC: Authorizing `identity:get_user(user_id=adae8298ffab4d39adc941c73b4200f7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.843840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.845679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 182/367] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/users/adae8298ffab4d39adc941c73b4200f7 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.846202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.846385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:14.948576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59610499-fa78-4f49-a174-c1bc76c3dded None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.968139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:14.974876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eec262-7a78-495c-95ba-3e5738a6df0b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:14.984560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:14.985714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:14.986203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:14.986704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:14.988169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:14.989841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:14.992360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 186/368] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:14.993355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.017525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.018046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.018319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.018597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.030076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:15.038133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:15.039585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:15.040401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 183/369] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:15.041714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.080270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.105497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417b4e-140b-405d-a6f4-83d153d245e5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.140477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.141521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.142012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.142513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.151200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1ef5f-6751-435c-88ca-e2f746da1efa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.187446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.188203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.188510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.188770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.189609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] RBAC: Adding query filter params (role.id=db8ceda7dbe94858ba593290baefcca3, user.id=adae8298ffab4d39adc941c73b4200f7, scope.system=all) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:15.189921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.191760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.204570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 184/370] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/role_assignments?user.id=adae8298ffab4d39adc941c73b4200f7&scope.system=all&role.id=db8ceda7dbe94858ba593290baefcca3 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:15.205321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.220974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.222407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.224129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.372533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.375065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7f72-e01d-4031-8f80-1873891189a1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.422066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 187/371] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:15.424025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.429541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.430358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.430750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.431131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.432126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:15.432549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.434096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.443407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 185/372] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:15.445187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.556150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.588902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273b77f-0a76-4a65-9b65-1e55014f3742 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.637433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.638592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.639092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.639472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.642203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a340f3-74ee-475b-9533-6fc6cfce4a9c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.644709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.646175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.648781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 186/373] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:15.656532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.724693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.725735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.726022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.726842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.727640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:15.728018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.729400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.750304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 188/374] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:15.757848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.792787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7226b3b-18f6-4a83-9a7a-27607f912f7b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:15.835096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.837581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:15.838687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:15.839538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:15.840071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:15.842597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:15.845422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:15.848442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 187/375] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:15.857089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:15.892779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:15.959215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae369c-4677-43ae-a71b-34a381408bbe None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:16.026535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:16.027193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.027478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.027756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.056524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd306-9507-40ee-97e9-0ad1b4c5ddd0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:16.118419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:16.119504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.120007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.120481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.121509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:16.121720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:16.122601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:16.123158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:16.124487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:16.135876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 188/376] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:16.185821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:16.274939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 189/377] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:16.280669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:16.402756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:16.431113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9ced-fe26-4262-828a-0de66d49a0fe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:16.468155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:16.469032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.469320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.469599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] PATH_INFO: `/v3/projects/281f6db1d408416ba80a23879b0e7fcf` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.470808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=281f6db1d408416ba80a23879b0e7fcf)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:16.472292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:16.474436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 189/378] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:16 2022] GET /identity/v3/projects/281f6db1d408416ba80a23879b0e7fcf => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:16.480189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:16.618622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937eb1b-bf30-4d33-8f76-92aba1ed0588 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:16.657123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:16.658144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.658432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.658710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] PATH_INFO: `/v3/groups/0434b497852e42d3be9605b0209ac4d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.665059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] RBAC: Authorizing `identity:get_group(group_id=0434b497852e42d3be9605b0209ac4d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:16.666685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4943f-9666-48fc-80b9-5ac4131687e7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:16.668498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 190/379] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:16 2022] GET /identity/v3/groups/0434b497852e42d3be9605b0209ac4d5 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:16.676213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:16.837337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1581ef9-2100-4d42-ba22-ab4c7e99a6a4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:16.880311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:16.880974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.881262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.881541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.882955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] RBAC: Adding query filter params (group.id=0434b497852e42d3be9605b0209ac4d5, role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=281f6db1d408416ba80a23879b0e7fcf) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:16.883273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:16.884735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd8cf2-cdcd-4e11-bea0-701fd910f6e9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:16.895312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 190/380] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:16 2022] GET /identity/v3/role_assignments?group.id=0434b497852e42d3be9605b0209ac4d5&scope.project.id=281f6db1d408416ba80a23879b0e7fcf&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:16.951322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97b9b-31e6-4d6c-af56-3660c12afac9 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.951575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97b9b-31e6-4d6c-af56-3660c12afac9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.951817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97b9b-31e6-4d6c-af56-3660c12afac9 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.953620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 191/381] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:16.959158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3185-387c-4787-b10d-dda882b1a006 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:16.959452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3185-387c-4787-b10d-dda882b1a006 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:16.959736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3185-387c-4787-b10d-dda882b1a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:16.981808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-56ca3185-387c-4787-b10d-dda882b1a006 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:16.983062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56ca3185-387c-4787-b10d-dda882b1a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:16.985565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.067576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 191/382] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:17.102158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac97b9b-31e6-4d6c-af56-3660c12afac9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.106426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.205155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82288d-7282-4bbf-ad11-4be6104f4b9e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.205465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82288d-7282-4bbf-ad11-4be6104f4b9e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.205622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82288d-7282-4bbf-ad11-4be6104f4b9e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.206999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 192/383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:17.217481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.217777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.218060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.226628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac97b9b-31e6-4d6c-af56-3660c12afac9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:17.254826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:17.256053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:17.295574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:17.298128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.298415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.298697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.318308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:17.335795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:17.337961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:17.340013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 192/384] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:17.343934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.396051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 193/385] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:17.419163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.456089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.518704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6eb5e-f43d-43f1-90c2-baa834962002 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:17.560093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:17.560093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.560093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.560093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.560505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] RBAC: Adding query filter params (name=member) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:17.560505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:17.560635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.560707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:17.571060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 193/386] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:17.575977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.584186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae216bc-5a30-4e6f-a986-09eb056c6511 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:17.642986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:17.644175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.644689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.645075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.657921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:17.666485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:17.667588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:17.668595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:17.670861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 194/387] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:17.676510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.770647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae277-6231-41ba-8f91-b3616d199058 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:17.832333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.845550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:17.846804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.848529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.849158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.851362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:17.854237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:17.857281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 194/388] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:17.866728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.892910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733937f-b1d5-40f5-b385-1a1d50853a55 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:17.939088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:17.950277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:17.951191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.951482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.951763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.953475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:17.953796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:17.955162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996becf7-5853-4891-82a6-5c8f690fb8c0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:17.966675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 195/389] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:17.968279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdac87-3353-4a2d-8b42-cdb7b5e37aaf None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:17.968619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdac87-3353-4a2d-8b42-cdb7b5e37aaf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:17.969083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdac87-3353-4a2d-8b42-cdb7b5e37aaf None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:17.975116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 196/390] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:17.976095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdac87-3353-4a2d-8b42-cdb7b5e37aaf None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:17.988890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e9f0-4a89-4929-ac2e-9866350b3e03 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.028468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.029571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.030001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.030437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.031894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.033602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31187863-2b92-40ef-a3f3-591c64bf1c43 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.035571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 195/391] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:18.041479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.042045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.042500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.060787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:18.062264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:18.095344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdac87-3353-4a2d-8b42-cdb7b5e37aaf None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.125080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.133989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.134881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.135135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.135410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.136603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.138132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.139657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 196/392] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:18.140775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.144749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 197/393] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:17 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:18.149353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.224787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.252328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33393dac-ad57-4e1e-84e6-8af5e64f038c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.271587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe8cc-177b-4256-bcef-9647ee55e8bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.290840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.292086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.292544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.292974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.295593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, group_id=52addbb4d4064b7ebbf4160c43bb5ce5, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.297366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.308056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.309089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.309376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.309815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.311440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.313230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.315565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 198/394] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:18.320038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.320172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 197/395] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 23 08:57:18 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:18.322318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.452370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.485116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6b6f8-33ed-45d6-868e-eaf4ea77a168 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.512046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.523311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.524366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.524366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.524657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.535655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:18.541445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b9b7c-7b0c-46c8-a827-fc995e5c67ee None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:18.544577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:18.545487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:18.546702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 199/396] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:18.551617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.591366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.592636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.593181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.593674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.596229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, group_id=52addbb4d4064b7ebbf4160c43bb5ce5, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.605454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.623862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 198/397] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 23 08:57:18 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:18.670341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524478-8213-4e1e-8c48-ac88d2f7aaec None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.709293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.710057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.710343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.710716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.711535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:18.711877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.713297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b3292-58f4-4d04-8ea5-2f4974ba812b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.723253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 200/398] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:18.729379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.737103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338772-1264-4c72-ae43-0c325c05d93f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.737394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338772-1264-4c72-ae43-0c325c05d93f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.737658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338772-1264-4c72-ae43-0c325c05d93f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.740185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 201/399] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:18.758395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.758684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.758961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.796908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:18.801691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:18.873844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.902077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 202/400] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:18.906204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db7c-1949-40c0-81e5-1434f7d7ef3a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:18.916914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:18.928174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:18.946287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:18.947206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:18.947512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:18.947781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:18.948993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:18.950445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:18.953175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 199/401] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:18.959278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.109676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981682c-4f89-449c-b234-3ff30bf94e79 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.145703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea926-8de7-4fc2-aa90-220db6f3b79d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.177443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.178261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.178547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.178857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.200115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:19.215715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:19.216111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:19.217070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:19.217891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:19.218503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.218503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.218503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.218503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:19.219782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:19.221243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 203/402] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:19.222072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 200/403] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:18 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:19.227245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.228895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.288682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:19.308215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:19.357245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d057-bd99-4a10-8a9f-97cd422d2d0f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.386668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafeaa2-b4e9-4572-8e58-b02fd656e2ce None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.392116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.393062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.393420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.393757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.396176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] RBAC: Authorizing `identity:create_grant(project_id=c7f11133ace74afa951f5a6e2f9dadfd, group_id=52addbb4d4064b7ebbf4160c43bb5ce5, role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:19.397822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648f6a5-428c-4b15-8d65-2388a1f3d94c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:19.419500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 204/404] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 23 08:57:19 2022] PUT /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:19.421307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9afee-7af9-4de8-8288-0224b5e810b3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.421657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9afee-7af9-4de8-8288-0224b5e810b3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.421989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9afee-7af9-4de8-8288-0224b5e810b3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.423528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 205/405] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:19.428592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.429854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.429964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.430189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.430303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.430454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.430599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.431187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:19.431508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:19.433109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:19.443212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 201/406] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:19.452779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.458343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:19.460010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:19.568753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199baffb-8b88-46e0-8ee1-6bc04e413f56 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.598666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:19.609078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.609931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.610219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.610496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.611808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:19.613422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:19.615218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 202/407] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:19 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:19.621236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.622590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 206/408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:19.649203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.680477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:19.731525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199e21-a97e-4e94-bfee-88c0df48395f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.765331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f230f7-6f14-49df-aa09-19a9c0eebbc9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:19.765882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.766750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.767034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.767309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.773395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:19.773395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:19.773395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 203/409] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:19 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:19.786669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.856664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:19.857467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:19.857752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:19.858028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:19.862570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:19.877208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:19.889624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:19.890686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:19.891660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:19.893324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 207/410] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:19.899837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:19.965793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638252-5336-4a7a-9081-5178079ce7fa None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:20.005288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:20.006186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.006473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.007287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.009610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=72f0a9b62b124306a0bf3edc0ba6563a, group_id=52addbb4d4064b7ebbf4160c43bb5ce5, role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:20.011639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:20.027688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 204/411] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 23 08:57:19 2022] PUT /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a/groups/52addbb4d4064b7ebbf4160c43bb5ce5/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 08:57:20.089606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:20.107768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b8bc-6a2f-4d6e-8b7a-a9f4d5df4e6a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:20.159169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:20.159775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.160088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.160344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.161123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:20.161436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:20.162841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:20.172767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 208/412] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:20.180509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:20.302903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffafd0e-f9f2-4306-ac1c-f52de692b9d9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:20.305872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:20.339811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:20.340721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.341406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.341690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] PATH_INFO: `/v3/groups/0434b497852e42d3be9605b0209ac4d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.342902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] RBAC: Authorizing `identity:get_group(group_id=0434b497852e42d3be9605b0209ac4d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:20.344656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:20.347032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 205/413] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:20 2022] GET /identity/v3/groups/0434b497852e42d3be9605b0209ac4d5 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:20.357056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:20.493600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0acc-8bd7-404e-b37b-d907c0049f2f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:20.538004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:20.539095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.539546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.539980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] PATH_INFO: `/v3/projects/281f6db1d408416ba80a23879b0e7fcf` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.541324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] RBAC: Authorizing `identity:get_project(project_id=281f6db1d408416ba80a23879b0e7fcf)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:20.542887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eadc2-94a0-47ec-88e6-2ccd95af3b02 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:20.544751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 209/414] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:20 2022] GET /identity/v3/projects/281f6db1d408416ba80a23879b0e7fcf => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:20.550433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:20.707145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d85e7-fb92-4bca-96b1-65a2770d025c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:20.742676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:20.743560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.743895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.744140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] PATH_INFO: `/v3/projects/281f6db1d408416ba80a23879b0e7fcf/groups/0434b497852e42d3be9605b0209ac4d5/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.746104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] RBAC: Authorizing `identity:create_grant(project_id=281f6db1d408416ba80a23879b0e7fcf, group_id=0434b497852e42d3be9605b0209ac4d5, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:20.747519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f4c50-e8ef-4ce8-978f-0bc73725b992 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:20.772758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 206/415] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 23 08:57:20 2022] PUT /identity/v3/projects/281f6db1d408416ba80a23879b0e7fcf/groups/0434b497852e42d3be9605b0209ac4d5/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:20.971484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b935a-c99e-4dbc-a5b5-eb062dc87f58 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.971903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b935a-c99e-4dbc-a5b5-eb062dc87f58 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.972138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b935a-c99e-4dbc-a5b5-eb062dc87f58 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.973541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 210/416] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:20.979731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc33fe6-0830-4f2e-b51c-098b0464832d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:20.980073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc33fe6-0830-4f2e-b51c-098b0464832d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:20.980326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc33fe6-0830-4f2e-b51c-098b0464832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:20.998114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-bdc33fe6-0830-4f2e-b51c-098b0464832d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:20.999231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bdc33fe6-0830-4f2e-b51c-098b0464832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:21.027588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:21.076747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 207/417] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:21.101792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b935a-c99e-4dbc-a5b5-eb062dc87f58 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:21.125755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:21.234730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b935a-c99e-4dbc-a5b5-eb062dc87f58 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:21.252196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50f4d-b4f3-49ef-ba7e-0c1493161cdd None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.252492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50f4d-b4f3-49ef-ba7e-0c1493161cdd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.252779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50f4d-b4f3-49ef-ba7e-0c1493161cdd None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.254413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 208/418] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:21.259685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.260000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.260290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.274728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:21.275525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.275810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.276116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.289161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:21.295774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:21.296993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:21.303462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:21.305203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:21.307401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 211/419] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:21.317765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:21.428134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:21.453944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6db0-ab81-4c3e-a333-8c8ee47a73ed None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:21.466739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 209/420] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:21.491536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:21.492292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.492575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.493113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.494454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:21.494927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:21.496397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:21.505619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 212/421] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:21.511516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:21.514810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:21.692690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:21.706248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e933d-d2c2-4d41-a129-61f549fa262b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:21.722696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57edeb6-bd74-45a1-b06b-138de6a74dba None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:21.759050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:21.760208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.760688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.761190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.779421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:21.780043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:21.780950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:21.781133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:21.785824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:21.788376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:21.802489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:21.803434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 08:57:21.805301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:21.808005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 213/422] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:21.811927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:21.918161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:21.919890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c6687-b683-4b78-919e-abb64a1ee9c3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.003944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53cdb-04f6-424e-a57f-09626d4d0fa6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.019025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.030724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 210/423] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:22.036331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a906-039e-421b-b9a5-e35277762248 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.036801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a906-039e-421b-b9a5-e35277762248 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.037237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a906-039e-421b-b9a5-e35277762248 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.038339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.039017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.039307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.039425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 211/424] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:22.039809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.040723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a906-039e-421b-b9a5-e35277762248 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.044325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:22.044660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.046145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edeb72-b5cf-4156-b229-e117f11087b4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.055676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 214/425] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.061493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.061794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.062082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.079287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:22.080520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:22.144369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.148793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 215/426] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:22.151192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a906-039e-421b-b9a5-e35277762248 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.156323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.189422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.190695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.191452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.191921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.193442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.195236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.197612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 212/427] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.202840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.268834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.278492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a2dd5-020b-43d9-84bb-9ffea4cdf5d5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.314329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb43d12-c62f-43f1-8265-542b2ae4ec16 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.314515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.315018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.315305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.315613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.359100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.360235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.360837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.361283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.374457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:22.384567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:22.385440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:22.386246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:22.388089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 213/428] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:22.389130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.398674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.408526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.410112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.517198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 216/429] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:22.521064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d31dad-2cef-40c8-bd2f-7940f0a8aa6f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.522899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.544223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.558884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.559761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.560048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.560329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.561510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.562944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdea99-652e-4a4e-91c9-387a80243f09 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 214/430] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51839-7002-4ae7-9c62-97b6d8d8673e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51839-7002-4ae7-9c62-97b6d8d8673e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51839-7002-4ae7-9c62-97b6d8d8673e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 215/431] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:22.569433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a51839-7002-4ae7-9c62-97b6d8d8673e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.628683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.639499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2c671-9e52-4613-bb11-c6f913f617ee None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.677354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.678289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.678602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.678884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.679636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:22.680037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.681593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.685293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a51839-7002-4ae7-9c62-97b6d8d8673e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.694387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 217/432] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.694387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.726228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.727088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.727605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.727720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.728843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.730292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9af41-bd0a-4199-b8dd-705ab5d6827d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.732003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 216/433] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.733137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.733425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.733702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.752242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:22.753422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:22.802676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d38bec-f4cc-4fc6-98a7-887234a69c62 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.807916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.835978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 217/434] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:22.835978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.848454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.849209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:22.849679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:22.850030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:22.851512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:22.851935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:22.853670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:22.860715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 218/435] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=b0d592c729db4128afedc886fb5dece6 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:22.871983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:22.891396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:22.956420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609f7e9-6163-44f2-8315-b5a99f3c03f5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.993401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6495d-962a-4f54-90c7-9980c37b4f40 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:22.998932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:22.999867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.000349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.000788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.033387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.034500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.034887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.035264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.036745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.038819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.041103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 219/436] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:23.041612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.081814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.109789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.111379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.146273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.164559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dae4c9-6e8b-41ea-a9da-06654ca005cb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.207555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.208658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.208954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.209477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.217976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 218/437] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:23.217976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.226126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:23.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:23.235767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:23.236628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 220/438] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:23.237458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.309950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.328081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6c8dc-53f0-496b-b464-cb45d3eaeb0c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.344300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a2a58-d4a1-4814-b913-4446baf3c4d3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.362583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.363251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.363598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.363882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.365311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=b0d592c729db4128afedc886fb5dece6, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:23.365859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.368047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10053be-c6e9-42a9-933b-5cb7d65f6f1c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.375890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 219/439] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=b0d592c729db4128afedc886fb5dece6 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:23.377427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb3d2-e128-4413-8cbb-9aa870c2fd1a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.377720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb3d2-e128-4413-8cbb-9aa870c2fd1a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.378089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb3d2-e128-4413-8cbb-9aa870c2fd1a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.379616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 220/440] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:23.380368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.380516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb3d2-e128-4413-8cbb-9aa870c2fd1a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.381304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.381727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.382205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] PATH_INFO: `/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.384387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] RBAC: Authorizing `identity:get_project(project_id=c7f11133ace74afa951f5a6e2f9dadfd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.386198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.393222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 221/441] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/projects/c7f11133ace74afa951f5a6e2f9dadfd => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:23.394691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.417777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.513482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6afa-e3ed-4f94-b45f-14b2d5e3d5cb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.529856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb3d2-e128-4413-8cbb-9aa870c2fd1a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.552251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.553131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.553415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.553732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.554951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.556445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f97825-5446-4657-95d6-019a66dc02b7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.558103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 222/442] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:23.559255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c358a-2c45-4040-977f-1150cb976fab None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.559553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c358a-2c45-4040-977f-1150cb976fab None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.559830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c358a-2c45-4040-977f-1150cb976fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.581286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.581988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.582274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.582560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.583326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:23.583924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.585662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.589895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-702c358a-2c45-4040-977f-1150cb976fab None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:23.594901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-702c358a-2c45-4040-977f-1150cb976fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:23.596077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 221/443] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:23.596648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.618097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.720409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 223/444] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:23.722064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c358a-2c45-4040-977f-1150cb976fab None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.739939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434138-88db-4b42-9da9-6b30fb2e2862 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.752486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.797433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.798353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.798844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.799267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.800436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:23.802863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:23.804734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:23.816394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 222/445] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=c7f11133ace74afa951f5a6e2f9dadfd&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:23.816394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:23.886788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c358a-2c45-4040-977f-1150cb976fab None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:23.943156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:23.943852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:23.944718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:23.945000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:23.952119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:23.991648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67210c1-4827-459c-8eba-5e6713bb644d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.039147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.039998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.040335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.040619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.054457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.055269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:24.056235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:24.063185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:24.064686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:24.066056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 223/446] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:24.070898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.078170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.188081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 224/447] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:24.194944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.207138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0ac3-81a9-4c41-a652-812a18dae21f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.245183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.245863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.246153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.246434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.247196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:24.247510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.248919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.252220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.260080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 224/448] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:24.265680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.315158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f204c13-e222-472a-b19a-03f19c97796b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.330192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.356326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.357270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.357544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.357817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] PATH_INFO: `/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.359022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] RBAC: Authorizing `identity:get_project(project_id=72f0a9b62b124306a0bf3edc0ba6563a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.360567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.362429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 225/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/projects/72f0a9b62b124306a0bf3edc0ba6563a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:24.368280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.377991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1796460-d6b9-4a11-9b09-03c463f2d870 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.412241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.413400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.413696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.413975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.464210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe45fa-f64d-445d-b476-3f538acf9d70 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.477977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.481982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.483621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.498871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.499731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.500052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.500337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] PATH_INFO: `/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.501531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] RBAC: Authorizing `identity:get_group(group_id=52addbb4d4064b7ebbf4160c43bb5ce5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.502955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.504629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 226/450] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/groups/52addbb4d4064b7ebbf4160c43bb5ce5 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:24.510422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.558107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.581972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 225/451] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 08:57:24.587668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.610740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92569c-4a24-4dcf-84ab-97424a6b19f3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.644482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.645207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.645500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.645784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.646617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] RBAC: Adding query filter params (group.id=52addbb4d4064b7ebbf4160c43bb5ce5, role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:24.646940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.648443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.654212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 227/452] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/role_assignments?group.id=52addbb4d4064b7ebbf4160c43bb5ce5&scope.project.id=72f0a9b62b124306a0bf3edc0ba6563a&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:24.686952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.691228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe52e1-0cab-48f4-8c7b-3cdb126303a8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.727732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.728557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.728843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.729123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] PATH_INFO: `/v3/projects/281f6db1d408416ba80a23879b0e7fcf` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.730364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] RBAC: Authorizing `identity:get_project(project_id=281f6db1d408416ba80a23879b0e7fcf)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.731816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.733621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 226/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/projects/281f6db1d408416ba80a23879b0e7fcf => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:24.739243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.842130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ddf5-d042-4612-b25b-3787808af1d8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:24.855705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:24.877589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:24.878450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:24.878739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:24.879020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] PATH_INFO: `/v3/groups/0434b497852e42d3be9605b0209ac4d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:24.880244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] RBAC: Authorizing `identity:get_group(group_id=0434b497852e42d3be9605b0209ac4d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:24.882035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927256bb-80a9-4a92-a35f-b08fa89dcdf0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:24.883685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 228/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/groups/0434b497852e42d3be9605b0209ac4d5 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:24.889518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:24.996757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89f576-2f46-40a8-9111-665a59e0df31 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:25.029834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:25.030484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:25.030771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:25.031049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:25.031882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] RBAC: Adding query filter params (group.id=0434b497852e42d3be9605b0209ac4d5, role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=281f6db1d408416ba80a23879b0e7fcf) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:25.032233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:25.033675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c345e38-d8b5-4975-9442-429c9b62ff08 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:25.039378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 227/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 23 08:57:24 2022] GET /identity/v3/role_assignments?group.id=0434b497852e42d3be9605b0209ac4d5&scope.project.id=281f6db1d408416ba80a23879b0e7fcf&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:27.437733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de256422-f37c-4e5d-b735-60375e289a53 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:27.438249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de256422-f37c-4e5d-b735-60375e289a53 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:27.438327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de256422-f37c-4e5d-b735-60375e289a53 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:27.439918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 229/456] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:27.445685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acdbfe-4f7a-4153-892c-1110c0380dc9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:27.446107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acdbfe-4f7a-4153-892c-1110c0380dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:27.446290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acdbfe-4f7a-4153-892c-1110c0380dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:27.465507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-09acdbfe-4f7a-4153-892c-1110c0380dc9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:27.466697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-09acdbfe-4f7a-4153-892c-1110c0380dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:27.498962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:27.554293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 228/457] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:27.601502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de256422-f37c-4e5d-b735-60375e289a53 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:27.717701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653564-27a7-4952-b7ae-3e4366ce1807 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:27.718365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653564-27a7-4952-b7ae-3e4366ce1807 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:27.718833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653564-27a7-4952-b7ae-3e4366ce1807 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:27.724712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 229/458] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:27.729774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:27.730317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:27.730432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de256422-f37c-4e5d-b735-60375e289a53 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:27.730912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:27.764600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:27.766287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:27.788494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:27.789633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:27.790128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:27.791977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:27.811319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:27.815449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:27.850190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:27.851171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:27.852059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:27.852059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:27.852059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:27.852059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:27.855879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 230/459] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:27.862939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:27.901497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 230/460] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:27.923060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:27.923508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.020581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed3787-26f3-46e7-b672-92afb18f94fa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.023017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.033612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f85f-a207-4a1b-a074-069f2285ea72 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.060050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.061076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.061571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.062052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.063017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:28.063532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.065144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c9e2-197b-4b30-885e-8a9e45e90946 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.071843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.072665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.072946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.073225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.079927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 231/461] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:28.081524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c57b-43dc-4b24-a0b7-32d0f2ea2674 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.082023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c57b-43dc-4b24-a0b7-32d0f2ea2674 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.082537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c57b-43dc-4b24-a0b7-32d0f2ea2674 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.084289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 232/462] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:28.088826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c57b-43dc-4b24-a0b7-32d0f2ea2674 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.089206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.090691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-748eab9a-b616-40e9-99f2-fe4e0f5258ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:28.110653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:28.111561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:28.112466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:28.112466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:28.112466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.112466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:28.117161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 231/463] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:28.118531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.118764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.119052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.136791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:28.137965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:28.197356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.206964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 232/464] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:28.207902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.209337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c57b-43dc-4b24-a0b7-32d0f2ea2674 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.247458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.248176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.248468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.248758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.249457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.250906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020ff9-785d-4590-9900-eee4718b8d2e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.273245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 233/465] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:28 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:28.277618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69b11-6db2-4d15-88f9-dbff75c6658d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.278333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69b11-6db2-4d15-88f9-dbff75c6658d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.278621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69b11-6db2-4d15-88f9-dbff75c6658d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.284441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 234/466] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:28.284441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69b11-6db2-4d15-88f9-dbff75c6658d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.297110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.347995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7a06-eac5-4513-a6b3-9fad0d40fb68 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.399629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82626645-7457-4f13-a584-643279de0014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.401699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82626645-7457-4f13-a584-643279de0014 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.402181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82626645-7457-4f13-a584-643279de0014 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.402665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82626645-7457-4f13-a584-643279de0014 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.404406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82626645-7457-4f13-a584-643279de0014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:28.404961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82626645-7457-4f13-a584-643279de0014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.407178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82626645-7457-4f13-a584-643279de0014 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.427098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69b11-6db2-4d15-88f9-dbff75c6658d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.436867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 233/467] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:28.438246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.438540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.438815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.458608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:28.459845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:28.473412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.474831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.476929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.477402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.491621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.494840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.505551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:28.520009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:28.520884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:28.521762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:28.521762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:28.521762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.521762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:28.524782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 235/468] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:28.525841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.547851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 234/469] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:28.548890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.648563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.649249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793616c-7d26-402f-a430-f314f409e5ad None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.697281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b78098-dc27-4054-8ac7-ee638dfdf76e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.698191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.699321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.700680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.701171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.702082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.703703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.733117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 236/470] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:28 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:28.734294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.737156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.737942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.738357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.739554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.739554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:28.739979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.741690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.757725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 235/471] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:28.763760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:28.815489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.874926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34f16-279b-428e-af93-868172c38c99 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.922612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b5e8-cd23-418c-aa08-28a3403200d2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:28.954400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:28.956076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.956880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.957164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.957559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.970811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.972495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.973243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:28.974139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:28.974526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:28.975015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:28.976072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:28.977623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4391811-c8a0-4e3b-9063-f60a8988cba2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:28.993101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:28.994113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:28.995673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:28.995673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:28.995673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:28.995673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:28.999648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 237/472] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:29.000913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:29.006482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 236/473] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:28 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:29.039828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeca71-6bc5-4143-8dc9-2fba30946134 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.040496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeca71-6bc5-4143-8dc9-2fba30946134 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.040990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baeca71-6bc5-4143-8dc9-2fba30946134 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.043077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 237/474] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:29.049879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.050529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.051066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.071062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:29.072723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:29.129035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49635d3-3f3d-4cbd-b017-95a5b9a8dcc6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:29.139621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:29.155088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 238/475] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:29.171325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:29.172068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.172374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.172653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.173395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:29.173752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:29.175203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:29.182720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:29.190401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 238/476] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:29.195371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:29.307536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25508613-56f6-44e1-a49b-53f0968431f5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:29.318366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd16e-aec8-46b3-96f2-b7f645d7b62a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:29.332721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:29.351058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:29.351753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.352475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.352773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.353493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:29.355318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:29.372501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:29.373249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.373826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.374032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.376191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:29.379399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:29.384430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 239/477] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:29 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:57:29.389761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.sql.core [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 08:57:29.389761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 08:57:29.389761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [parameters: {'id': 'd6c50778eb744475b9db5b091aeb679f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 08:57:29.389761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80402) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:57:29.410491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:57:29.411554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application yield resource Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise self.value Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application session.commit() Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 08:57:29.412546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.flush() Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application compat.raise_( Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 08:57:29.413466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:57:29.414334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:57:29.415166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [parameters: {'id': 'd6c50778eb744475b9db5b091aeb679f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:29.417078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 08:57:29.418110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:29.419128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 239/478] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 23 08:57:29 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:29.422225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:29.469337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:29.583092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae342-64b6-4909-add3-e4958f1d901c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:29.634033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:29.635201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.635693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.636227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.648556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5575e972-d505-4d85-9e42-c61ba750b38d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:29.657202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:29.658121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 08:57:29.658948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:29.661658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 240/479] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:57:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:29.667602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:29.776758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0241b-060e-4a0b-900a-bb964e1340c4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:29.815423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:29.816638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:29.817074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:29.817525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:29.818545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:29.819047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:29.820690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0897b-45ff-463a-8f42-5283015ff024 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:29.830106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 240/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:30.634758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283bee-10d8-4d28-8dfe-4e3031314a35 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:30.635622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283bee-10d8-4d28-8dfe-4e3031314a35 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:30.636102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7283bee-10d8-4d28-8dfe-4e3031314a35 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:30.637685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 241/481] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:30.643492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:30.644064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:30.644534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:30.663356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:30.664876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:30.694875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:30.750909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 241/482] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:30.774681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283bee-10d8-4d28-8dfe-4e3031314a35 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:30.879484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:30.896956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7283bee-10d8-4d28-8dfe-4e3031314a35 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:30.930732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:30.931524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:30.931807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:30.932109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:30.942674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:30.951019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:30.951936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:30.952788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 242/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:30.959704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.079181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b8f1b-52dc-4f78-bf45-d18f7aa5c8d2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.121443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.122454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.122934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.123395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.124370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:31.124872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:31.126452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672f1e9-084e-4d2e-9cb3-e538185197d8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:31.140204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 242/484] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:31.141794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.300316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27db69-0ae7-4112-9068-c7db3698ea6a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.342617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.343428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.343806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.344006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.355849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:31.357349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:31.359374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5371-ec09-4a7f-9406-cb56b770bde0 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.359669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5371-ec09-4a7f-9406-cb56b770bde0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.359966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a5371-ec09-4a7f-9406-cb56b770bde0 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.362774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 243/485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:31.367482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.367777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.368112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:31.382352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:31.383201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:31.384087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:31.384087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:31.384087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:31.384087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:31.384087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 243/486] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:31.385224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:31.394086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.409368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:31.410900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:31.449412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:31.495871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6eda7-0f4c-4959-b7a3-fc90d09fb8db None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.529980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.530640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.530922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.531197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.531927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:31.532265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:31.533634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:31.539172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 244/487] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:31.546805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 244/488] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:31.551966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.576269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.687521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:31.727533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d46f2-f1eb-457a-88f5-deb2a80cd537 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.762126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.762923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.763204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.763477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.770818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98070-be83-489f-a79e-57a3652d9993 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.774550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:31.789512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:31.790438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:31.791240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 245/489] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:31.797612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.833422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.834232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.834518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.835343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.843402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:31.844966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-7e4df612-5c96-4a50-8c8b-e6432d8b2440 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:31.862542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:31.863485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:31.864410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 245/490] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:31.866445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f808-02a2-4c59-9a63-ac6c9461c364 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.866445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f808-02a2-4c59-9a63-ac6c9461c364 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.866445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f808-02a2-4c59-9a63-ac6c9461c364 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.868164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 246/491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:31.873437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.873840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.874222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.895778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:31.898227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:31.910792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:31.919896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9f79a-5229-4ac9-8ed3-c7659efbb9f7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:31.936799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:31.960304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:31.961254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:31.961706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:31.962152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:31.963193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:31.963726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:31.965317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:31.974328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 246/493] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:31.975417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:31.978808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 247/493] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:31.980171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.083526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53276dbb-134a-457f-bd4f-12b5309133ba None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.095912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd277-1f75-4c7b-bbdf-7c7522f04a11 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.121275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.122347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.122806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.123277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.124525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:32.125013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.126751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.132615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.133411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.133699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.133972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.144617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.146073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.153604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:32.166090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:32.166984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:32.167852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:32.167852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:32.167852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:32.167852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:32.167852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 248/494] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:32.169001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.173594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 247/495] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:57:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:32.174654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.216953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.285650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42503b30-fadb-44d3-954a-ac767aa21ce9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.286600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e0652-a089-4b3f-9f66-3d04588e042b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.327171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.327747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.328403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.328516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.328714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.328997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.329234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.329642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.329823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:32.330040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.331433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.343656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 248/496] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:32.344909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.348663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-578613b8-0f3a-4b37-b232-6d8e841b9c24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:32.358429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:32.359308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:32.360564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 249/497] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:32.362238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d914c4-5608-4fc0-a698-c53483923f3b None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.362527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d914c4-5608-4fc0-a698-c53483923f3b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.362804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d914c4-5608-4fc0-a698-c53483923f3b None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.368576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 250/498] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:32.368576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d914c4-5608-4fc0-a698-c53483923f3b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.429777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.451242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.457502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192ac92-eefe-4a29-b87e-caae4ae60f85 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.475422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d914c4-5608-4fc0-a698-c53483923f3b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.493149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.493797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.494085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.494365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.510752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.511552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.511833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.512140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.519710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.521200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:32.536994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:32.537951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:32.538860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 251/499] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:32.539421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.572915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.574406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa6997-f169-4002-8a92-2c4ba2e9f8c7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.647884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90fd3a-8ff1-4e9c-a788-ba5bab2bcec5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.665051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.670296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.677064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 249/500] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:32.678213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4ecd-5d55-4369-b640-27db75e26b0f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.679058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4ecd-5d55-4369-b640-27db75e26b0f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.679340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb4ecd-5d55-4369-b640-27db75e26b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.686798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.687542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.687899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.688216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.688975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:32.689292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.690677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.695693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d9eb4ecd-5d55-4369-b640-27db75e26b0f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:32.697364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d9eb4ecd-5d55-4369-b640-27db75e26b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:32.703640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 252/501] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:32.703640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.765021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 250/502] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:32.766389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740635-c24c-4d87-83cb-d7a99472c0e4 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.766745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740635-c24c-4d87-83cb-d7a99472c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.767029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46740635-c24c-4d87-83cb-d7a99472c0e4 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.768479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 251/503] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:32.769032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740635-c24c-4d87-83cb-d7a99472c0e4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.804067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0452-c0cc-4d83-82dc-697b3ebe27d8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.837275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.837943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.838226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.838505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.839336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:32.839645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.841099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.873885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46740635-c24c-4d87-83cb-d7a99472c0e4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:32.876911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 253/504] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:32.877727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:32.899260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.908381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:32.909168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.909449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.909722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.918532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:32.921687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:32.923131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-82cea8bc-baab-4b2e-8d9a-c988864da81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:32.941129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:32.942082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:32.942936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:32.942936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:32.942936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:32.942936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:32.942936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 252/505] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:32.943834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:32.944189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:32.944468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:32.959844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:32.961051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:32.980382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11259a0a-dafd-42e4-b90a-e16afa93e1d0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.014036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.014842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.015187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.015414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.025825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.026726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 253/506] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:33.027290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.027556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:33.051259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.052224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 254/507] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.053846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.127415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ee92-363f-43a2-bf0d-00c2c80d14af None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.136194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.140815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.151293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37f78-be8d-456e-a672-f0d4fd72ece4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.160976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.161764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.162046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.162324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.172852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:33.180538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.181439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:33.182406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 254/508] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.184765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.186374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.187020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.187306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.187585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.254711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.256201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.285103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec48422-7884-4a17-97a9-957b3dc0634a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.318549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.319226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.319483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.319758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.320515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:33.320822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.322185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.333493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 255/509] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:33.334270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.342974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.354439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 255/510] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:33.355251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.365067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.436874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f39948-47e9-42ac-9d18-0e790c86d056 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.452897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3df9b-adfc-4bed-b488-7583fe3485a6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.470820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.471606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.471897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.472204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.482056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.483496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.485986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.486637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.486920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.487194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.487902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:33.488240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.489585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.500504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 256/511] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:33.500721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.501523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.502362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:33.502362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:33.502362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.502362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:33.502569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.502637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 256/512] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.502637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.554337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.582762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.602690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6e5d1-ef02-4b75-9a5f-9549ed562b77 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.605978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84bd6f-ff57-4afc-ab3f-6367223d8d43 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.635895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.636710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.636992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.637266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.639014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.639679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.639988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.640273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.641030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:33.641344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.642718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.643791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.645243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.651182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 257/513] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:33.652030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:33.661617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.662558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:33.663430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 257/514] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.664347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.749317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d65b70-4554-4603-bcea-05777112a58b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.761608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff043f-356e-41b2-ba3f-59846e577843 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.762393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.783133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.784057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.784455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.784776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.794428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.795212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.795495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.795605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.795773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.797092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.803072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.805140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.807534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:33.815030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.816535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 258/515] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.817424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:33.822207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.823243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 258/516] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.825890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.929187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f86c55-f389-4cf6-bc5a-6aedffdd4881 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.931370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2ec7-e50c-4821-addd-3e9a0cc3b5ca None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:33.962246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.963046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.963335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.963616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.963706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:33.964322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:33.964605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:33.964882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:33.965606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:33.965913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.967290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.974762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:33.976240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:33.978670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 259/517] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:33.979449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:33.993812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:33.994841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:33.995703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:33.995703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:33.995703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:33.995703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:33.995703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 259/518] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:33.995988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.005789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.048000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.081071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a161-924b-49dd-b349-27cb9aac56cb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.095273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6fc8a-4cb1-4dfa-8043-2e9c8ddef98f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.113499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.114157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.114444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.114724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.115511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:34.116345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.117771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.127568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.128253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.128537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.128816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.129539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:34.129854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.131210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.135304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 260/519] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:34.136130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.144007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 260/520] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:34.144798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.217340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.233242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b299-cdf9-460b-9408-3621af075cd4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.243863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de116a72-99d0-4542-97c0-569742cf7614 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.256698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.266526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.267197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.267483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.267760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.268636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:34.268947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.270370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.277003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.277664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.277958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.278235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.278939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.280386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.287174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 261/521] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:34.288567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.306041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 261/522] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:34 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:34.306041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.409937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983360b-73c1-419f-bf18-f78c2f01d9d0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.433418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cbaff-068b-477d-92e4-fcf47abd433d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.451010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.451685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.452005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.452746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.453705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:34.453705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.454678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.466668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 262/523] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:34.467931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.470626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.480303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.481020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.481324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.481593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.482440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:34.482759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.484238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.490179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 262/524] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:34.490888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.532386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.597531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5559c-7a54-43b8-89a9-4d9f845f1b49 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.633543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d2ca-ce01-40cb-a122-7808aa1c90f5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.638152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.639104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.639487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.639860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.648453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.650174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:34.667511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:34.668587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:34.669560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:34.670159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 263/525] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:34.671874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.679186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.680645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.680934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.681215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.743453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.764069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.766218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.791484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397565-74e2-4d80-926d-5dff15399296 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:34.808444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:34.833270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:34.834803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:34.835315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:34.835790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:34.843602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:34.845402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:34.860824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:34.861843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:34.862766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:34.865148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 264/526] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:34.866842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.880175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 263/527] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:34.881230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:34.974085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175360-f6aa-4b29-b483-c5becd0ade61 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.001403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.014104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.014983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.015417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.015847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.016002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372966ba-9cf0-4784-8a53-2ffb7d0aff4e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.016934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:35.017394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.018968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.031882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 265/528] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:35.033126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.060474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.061387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.061828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.062161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.063076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:35.063445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.065130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.076323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.085336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 264/529] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 23 08:57:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:35.095061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.149168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c49f-63c2-49f9-96b8-8dded38afc81 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.189047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.190262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.191093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.191604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.204181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.206013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.212289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdab88-6d5b-4a1c-84d3-945082dadb1b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:35.226028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:35.226905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:35.227766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:35.227766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:35.227766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:35.227766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:35.230302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 266/530] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:35.231417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.246988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.247645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.247931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.248252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.249096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=bb4b2c43c8b74a2287730da251220971) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:35.249413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.250981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.256791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 265/531] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/role_assignments?user.id=bb4b2c43c8b74a2287730da251220971&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:35.257587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.272655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.354118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c2efc-bcdb-4dc7-be56-851afe5c2de7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.375906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.395524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.396583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.397660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.398145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.478637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.480571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.483035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49cf3-dbfb-4e4b-9959-6c9d3bd8d6aa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.519325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.552725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.553447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.553739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.554023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.554774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:35.555088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.556546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.579364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 266/532] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:35.584413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.638775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 267/533] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:35.644682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.739139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5432b-e8de-4b3b-b821-9decabfbc371 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.771102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5e76-75c7-4944-bb67-08e069355503 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:35.780966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.810925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.812529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.813020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.813495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.816166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:35.828228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.830358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:35.850167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:35.851475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:35.852378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:35.852378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:35.852378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:35.852378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:35.854598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 268/534] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:35.860428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:35.867994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:35.868809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:35.869095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:35.869372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:35.886350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:35.887807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:35.908209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:35.909144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:35.909997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:35.915314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 267/535] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:35.916883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:36.000399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79415dc-f360-4fca-8478-708344ff132e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.044774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.045618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.045915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.046279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.047646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:36.048279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.050458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.077844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 269/536] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:36.082730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:36.103917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f316b-b9d5-4386-8e6d-12e114b5a578 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.138881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.139888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.140422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.140897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.141897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:36.142435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.144095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.164405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 268/537] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:36.170343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:36.177021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:36.208558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:36.280186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1f24c-a0ee-49b3-b012-094f567d1dfa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.290413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e590c-c959-4b58-9691-491e4e7c1555 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.332131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.332784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.333074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.333359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.334454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=06721172c3954f708ed5cae461e62961) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:36.334798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.336243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.348635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 269/538] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:36 2022] GET /identity/v3/role_assignments?user.id=06721172c3954f708ed5cae461e62961&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:36.352687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.353513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.353798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.354074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.362213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.363715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:36.379103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:36.380031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:36.380892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 270/539] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:36.389617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:36.552575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:36.557328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29419-ea73-4f2a-855b-376882b896e4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.617462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.618124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.618413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.618692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.619496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:36.619809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.621275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d571a64-03a3-4330-9cfd-2b5570927d46 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.642477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 270/540] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:36.647971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:36.785338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12541-3311-4cfc-b03b-f040b47afb32 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.785837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12541-3311-4cfc-b03b-f040b47afb32 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.785911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f12541-3311-4cfc-b03b-f040b47afb32 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.787490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 271/541] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:36.793271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.793561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.793839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.816497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a110f1-ad9a-4e96-8405-fc00fd0264fd None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:36.822817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:36.824107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:36.829617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:36.868862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:36.870442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.870924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.871424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.872781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=13efde93abb94f78b4cf7b2df191136a) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:36.874167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:36.875809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c8cab-f442-4a45-88e7-2bf7c8d6e31c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:36.883649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 271/542] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:36 2022] GET /identity/v3/role_assignments?user.id=13efde93abb94f78b4cf7b2df191136a&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:36.885228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afb248-45bd-4971-92c4-3b4b8c749b64 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.885719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afb248-45bd-4971-92c4-3b4b8c749b64 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.886193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afb248-45bd-4971-92c4-3b4b8c749b64 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.888108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 272/543] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:36.898726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:36.899345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:36.899843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:36.934932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 272/544] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:36.935738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:36.940249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:36.983892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.077828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 273/545] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:37.093477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.105027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.107089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a6229-5cdc-4f89-9cb4-10aeae8c0e94 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.146026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.147756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.148278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.148781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.160412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:37.168763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:37.169714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:37.170526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:37.173246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 273/546] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:37.178602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.290934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8719aec-eb04-4676-ae70-f849a7633311 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.327800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.332815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54b2e-74c9-4735-9113-7cfc5851d971 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.348440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.349182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.349467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.349744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.351040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:37.351358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:37.352765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:37.371835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 274/547] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:37.374055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.396327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.401786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.402607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.402933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.403212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.425800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:37.434541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:37.435604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:37.436690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 274/548] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:37.447752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.544357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df347-7788-4a2a-b7ef-c311d7c00dfd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.560518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a215-e104-402f-9326-ec9de42d4a19 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.580325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.581123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.581409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.581686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.605743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:37.607213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:37.627113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.627784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.628375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.629132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:37.629443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:37.630808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:37.641365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:37.642686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:37.644573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:37.644573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:37.644573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:37.644573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:37.644573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 275/549] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:37.649572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.651939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 275/550] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:37.656892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.713622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.720441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.761347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5c56-5e3e-4c8d-b9fa-b8b4915f6f4f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.796635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.797391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.797585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.797863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.798591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:37.798900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:37.800287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:37.812663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 276/551] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:37.822157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:37.907815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b03191-96ef-4a9f-b8b9-245849421e45 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.939832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d33074-78db-4fd7-971d-8e7ea850077b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:37.963535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:37.975901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:37.976731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:37.977022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:37.977301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:37.984554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:37.986092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.000646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.001456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:38.001704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:38.003278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:38.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:38.006998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.006998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.007279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 277/552] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:38.010332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.033120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.034598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:38.074260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:38.076472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:38.078664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:38.078664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:38.078664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:38.078664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:38.080089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 276/553] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:38.084947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.115144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ea27e-f959-4d8c-b518-a21b333ba2a4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.151812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.152519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.152803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.153081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.154010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:38.154332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.155861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cdfad-00f8-4cbe-b61e-7f5fab1493b3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.164995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.178883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 278/554] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:38.180412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee97d-de29-44f2-8ce3-e81482508529 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.180706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee97d-de29-44f2-8ce3-e81482508529 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.180992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ee97d-de29-44f2-8ce3-e81482508529 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.182230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 279/555] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:38.184730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ee97d-de29-44f2-8ce3-e81482508529 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.201971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9d70-2f30-4620-ab03-dfb1b92fc004 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.235373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.243171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.243849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.244257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.244546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.245388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:38.245705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.247088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f17d9-1f95-4301-bbd9-06e839f0902f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.264588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 277/556] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:38.266138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.266437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.266721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.283934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:38.285270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:38.298790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ee97d-de29-44f2-8ce3-e81482508529 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.337482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.338151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.338469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.338747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.364331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 278/557] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:38.365330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.410333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.412040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.455478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.457888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.500146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483738-fb67-4644-a13a-b3dc15e1dcae None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.522466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 280/558] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:38.523453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.542301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.543201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.543493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.543776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.551621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.553231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:38.571942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:38.575265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 279/559] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:38.577719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.640988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7917-4a6f-4ca8-b953-5ee05d423896 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.676651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.677455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.677742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.678017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.685551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.686127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e43a3-6090-4e3e-870d-672d0d6aaf35 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.689067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3f7be710-4d58-4533-bc7c-4a81a42a72f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:38.697706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:38.698706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:38.699557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 281/560] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:38.700651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708bf3-fed3-47a5-8a61-58be92283630 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.700651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708bf3-fed3-47a5-8a61-58be92283630 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.700786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a708bf3-fed3-47a5-8a61-58be92283630 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.704067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 282/561] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:38.704067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a708bf3-fed3-47a5-8a61-58be92283630 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.721172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.733450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.734362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.734795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.735038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.747380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.749305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:38.771134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:38.772786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 280/562] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:38.773781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.817477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a708bf3-fed3-47a5-8a61-58be92283630 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.850824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.851495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.851781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.852090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.852930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:38.853248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.854671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848ba8-37d4-4a9d-8840-39316bdce915 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.871731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 283/563] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:38.872990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.873306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.873552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.889409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:38.890376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee21a-30db-44a5-b1aa-be33954c0cab None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:38.890598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:38.926401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:38.927719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:38.928214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:38.928670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:38.929571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:38.930101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:38.931639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:38.940547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 281/564] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:38.941907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.950595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:38.966545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 284/565] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:38.967534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:38.994900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.060747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46dc0e-decc-4547-989b-e5adee92428b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.077863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9e69-40af-4ef4-9e95-000b4fe186f5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.098222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.098893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.099183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.099496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.100265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:39.100585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.102212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.112252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.113050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.113340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.113616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.114734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 282/566] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:39.116388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.128685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.130177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:39.148863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.149780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.150718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:39.150718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:39.150718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:39.150718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:39.150718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 285/567] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.151476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.197139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.219606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.223622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24cf7f-cbd0-45d6-81a9-5227267daf00 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.253530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134fbf2-42e4-4367-8de6-d7fa79115b2e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.257915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.258706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.258993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.259274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.269672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.271144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.287035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.287855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:39.287977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.288898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.289821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:39.289821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:39.289821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:39.289821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:39.290057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.290057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.293680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 283/568] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.294553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.300389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:39.309853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.310840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 286/569] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.312288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.394191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e338c3-7d7a-42f3-acb5-7a5e7e9544ae None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.410783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.414343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c0696-6478-42c1-9167-79b44519aef8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.428138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.429540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.429822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.430096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.436777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.438206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.448998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.449656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.449943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.450220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.450941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:39.451249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a506f6ee-9263-4063-915a-c98e3c0bff60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:39.452559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.453429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:39.454406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:39.454847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.454920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 284/570] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.454997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5215-ad44-4b45-a302-ca9a2b431aa3 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.455316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5215-ad44-4b45-a302-ca9a2b431aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.455541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5215-ad44-4b45-a302-ca9a2b431aa3 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.456832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 285/571] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:39.457522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5215-ad44-4b45-a302-ca9a2b431aa3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.469424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.469726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 287/572] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:39.470559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.564045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5215-ad44-4b45-a302-ca9a2b431aa3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.567590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346de76-05c1-4b89-806f-c717fe4dec9d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.598189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.598856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.599144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.599424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.600784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:39.601097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.602481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.604134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.604807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.605091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.605384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.606137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:39.606447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.607801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dc32c-59b0-4ede-ad5d-d7557f80b6eb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.613877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 286/573] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:39.614673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.616604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 288/574] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:39.617654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.617945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.618224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.634786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:39.635998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:39.652098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.685154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.704227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 289/575] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:39.705050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.719060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e58e-65a2-4bfd-ae79-6e55de7a1231 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.753112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.753766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.754048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.754325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.755106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:39.755418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.756903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.768458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 287/576] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:39.769235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.801004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a5e4-77bf-4923-8e99-356e3ecba518 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.833378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.834105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.834395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.835201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.842210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.843662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:39.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.858670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:39.859564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 290/577] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.860078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.866530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50619391-760a-4b97-abe8-68af9d3c9d7d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:39.874761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.895365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:39.901848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:39.902646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:39.902936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:39.903220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:39.910179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:39.911613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:39.926623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:39.928042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 288/578] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:39.929033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:39.966571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697bc51-7763-4e29-bd31-340da6d62c82 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.004975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.005767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.006053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.006330 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.016891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.018339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.029585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7299c3c-48a7-4ea6-b23c-14d410d5caf9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:40.038626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:40.039499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:40.040430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:40.040430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:40.040430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.040430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:40.040430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 291/579] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:40.040703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.063556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.064387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.064671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.064944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.075191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:40.082913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:40.083878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 289/580] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:40.085429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.105711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.135676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.144407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119749a-2761-43e0-864d-3fd85481cd7f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.177419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.178070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.178361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.178641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.179475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=6f5ec849ef0e431d8ad7e84c94fac8c6) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.179790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.181251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.184960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6378-1164-47eb-a97b-582efa890a37 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.186709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 292/581] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/role_assignments?user.id=6f5ec849ef0e431d8ad7e84c94fac8c6&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.187483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.222317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.222999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.223285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.223563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.224414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.224729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.226249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.240242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 290/582] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.241173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.311606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10aa86-01b7-4428-a272-c0ab9a522139 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.345615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.354553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ecde4-cf34-4c00-8c60-c6850fb1b8de None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.355136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.355813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.356145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.356419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.357521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.357631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.358993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.367307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.382025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 293/583] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.382025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.393969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.394663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.395007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.395295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.396046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.396359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.398303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.410830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 291/584] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.415872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.489878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe77e1d-9340-4afe-bff2-40ab7b794d23 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.519250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548ca0-c211-466d-a84d-4cca78d24bde None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.527193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.527862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.528176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.528460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.529208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.529526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.530895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.539376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 294/585] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.539982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.559335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.560261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.560550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.560832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/194576b9361e47329a8c8682963953d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.577045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=b8fc0436447946d6b65f0ec3880a0c38, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.578486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.593768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.600531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 292/586] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:40 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:40.600531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.624978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.671984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c4761-e161-4c1f-bbea-5f83f6b430c8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.714194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.715200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.715628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.716094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.729262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.730956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.743638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629409d-48ec-4260-a056-c9eed6fb204a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:40.750846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:40.751829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:40.752775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:40.752775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:40.752775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.752775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:40.756931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 295/587] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:40.757807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.787137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.788728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.788728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.788728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.798307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.799769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:40.822287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:40.823494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 293/588] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:40.824725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.888255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.891649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646788a-0363-4fc5-8dff-f989b12a4259 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.911622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:40.932288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.933146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.933443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.933825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.934379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ea84-3eea-41c2-8731-a1d27f0d0d92 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:40.946385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.948131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:40.967138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:40.968246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:40.969467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:40.969467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:40.969467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:40.969467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:40.969709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:40.969799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:40.970013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:40.970294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:40.971030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:40.971343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:40.972117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 296/589] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:40.972728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:40.973397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:40.990109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 294/590] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:40.990109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.087942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875729-bd62-4231-92ff-a550c5f668fb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.092082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2ffa-5bb8-4ce6-8c41-15f3e925e1ec None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.124162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.124862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.125143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.125417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.126146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:41.126456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.127830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.138637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.141526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.146502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 295/591] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:41.146502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.146671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.146671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.146671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.146671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:41.146671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.152205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.172897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 297/592] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:41.174082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.192512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.275254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f976361-54aa-4c21-9021-94e999aadaa7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.312066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441a03-1cba-4495-ad5b-dca1ad963ebb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.313183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.313979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.314359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.314537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.323101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.324754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:41.339413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:41.340350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:41.341230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:41.342238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.361541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.362959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.363822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.364342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.375022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.377585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:41.398512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:41.399467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:41.400447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:41.407458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 298/594] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:41.408547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.408681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.453749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e93a80-6435-4d5d-93e4-b2a7a15a9591 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.481879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.490117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.491242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.491582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.491873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.503023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.504497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.515287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a4458-e85d-4807-a3f0-cf36e2ab0707 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:41.522571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:41.523454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:41.524387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:41.524387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:41.524387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:41.524387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:41.524387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 297/595] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:41.525062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.554584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.555573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.556183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.556663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.557698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:41.558226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.559995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.573129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 299/596] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:41.574239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.627922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b85e2-ac8a-458f-af16-7db6fc087feb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.641553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.669272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.669878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.670167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.670448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.671412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:41.671771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.673222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.689680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cc4c9-a5c8-4c92-9b49-fe863218c9f0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.696061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 298/597] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:41.696061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.731061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.740092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.741140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.741632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.742134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.743059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:41.743620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.745344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.759356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 300/598] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:41.760734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.814712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecab4e4-efff-46ff-95fb-c6fc2ad37bd6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.851392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.852318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.852621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.853012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/bb4b2c43c8b74a2287730da251220971/roles/194576b9361e47329a8c8682963953d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.868147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=bb4b2c43c8b74a2287730da251220971, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.869647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.874274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c8156-fa36-436a-9682-dcf9e487bf06 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:41.886188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 299/599] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:41 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/bb4b2c43c8b74a2287730da251220971/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:41.887136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:41.911826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:41.916418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:41.918012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:41.918531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:41.919039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:41.932968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:41.934800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:41.956244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:41.957243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:41.958138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:41.958138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:41.958138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:41.958138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:41.961184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 301/600] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:41.966904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.009791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7518214-69b4-479e-9765-acd47f4373f0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.019095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.047392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.048242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.048530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.048810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.057131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.058651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:42.074441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:42.075375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:42.076299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 300/601] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:42.088016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413471e2-9b62-4d84-a20b-51f69b1c5eec None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.089208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.127075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.128211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.128726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.129203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.130146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:42.130666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.132441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.145468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 302/602] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:42.151640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.232808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.253597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cbd9f-26a3-4aed-a4c3-57fba642822c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.269185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b64c-fb3c-4830-bcba-a98a49bfdada None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.270729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.305229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.306035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.306329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.306616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.312233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.312893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.313276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.313555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.313668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.314450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:42.314765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.315084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.317108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc585ad-d8e3-47f0-a147-9897a2c35f3c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:42.330070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:42.331045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:42.331977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:42.332418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 301/603] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:42.332494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 303/604] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:42.332570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3760-438d-48dc-9bdb-19e088686dbf None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.332570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3760-438d-48dc-9bdb-19e088686dbf None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.332570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3760-438d-48dc-9bdb-19e088686dbf None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.338024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 302/605] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:42.338538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.339200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3760-438d-48dc-9bdb-19e088686dbf None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.449030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b54967-37c7-43c7-becf-4c218f0f4e4f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.470022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3760-438d-48dc-9bdb-19e088686dbf None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.488711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.489536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.489831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.490144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/06721172c3954f708ed5cae461e62961/roles/194576b9361e47329a8c8682963953d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.509021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=06721172c3954f708ed5cae461e62961, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.510589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32997852-2a24-45d0-8a45-156034dee24b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.514061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.515130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.515633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.515929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.516808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:42.517134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.518665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.528442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.536383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 304/607] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:42 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/06721172c3954f708ed5cae461e62961/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 08:57:42.537382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 303/607] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:42.538564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.539369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.539861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.540387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.576885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:42.578717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:42.597064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.653569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f79bd-1b73-46ff-ad6a-b09c505fe389 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.691914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.693248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.694299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.694795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/13efde93abb94f78b4cf7b2df191136a/roles/194576b9361e47329a8c8682963953d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.712333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=13efde93abb94f78b4cf7b2df191136a, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:42.714161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436e0bb-c5bc-4bc3-acc0-47b41fc36a2f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:42.742287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 305/608] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:42.753015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 304/609] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:42 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/13efde93abb94f78b4cf7b2df191136a/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:42.766277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.887083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41727b96-197f-4c43-93d7-760c2ce29492 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:42.925538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:42.926358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.926648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.926926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.931079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520d13-167b-475d-acad-ae8ae3934fe8 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.931357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520d13-167b-475d-acad-ae8ae3934fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.931632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3520d13-167b-475d-acad-ae8ae3934fe8 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.933346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 305/610] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:42.939370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:42.939661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:42.939943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:42.941433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:42.951046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:42.952074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:42.952977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:42.954345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 306/611] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:42.959633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:42.964940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:42.972980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:42.974208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:43.031198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:43.064890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 306/612] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:43.088439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755eee2-64da-4311-9ad9-06d484894c52 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.125667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.126020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.126558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.126849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.127127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.128224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:43.128540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.129951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.140811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 307/613] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:43.149480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.222350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:43.265137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769818-4654-460e-9ce5-94d6408e3626 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.302310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.303085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.304045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.304333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.315701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.317405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.329047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2720d94-e828-4659-b668-41ed143e2b92 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:43.338178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:43.339091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:43.340025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:43.340025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:43.340025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:43.340025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:43.340025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 308/614] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:43.349123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.402087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.404470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.406173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.406456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.426973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:43.444200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:43.445138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:43.445958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:43.448775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 307/615] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:43.454117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.482189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec5f35-cef0-4f43-9454-0978749a9b66 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.499243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:43.517449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218365-3156-4d58-9899-9948f507578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.518114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218365-3156-4d58-9899-9948f507578d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.518402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218365-3156-4d58-9899-9948f507578d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.518685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e218365-3156-4d58-9899-9948f507578d None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.522895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e218365-3156-4d58-9899-9948f507578d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:43.522895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e218365-3156-4d58-9899-9948f507578d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.522895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e218365-3156-4d58-9899-9948f507578d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.533909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:43.534236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 309/616] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:43.539928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218365-3156-4d58-9899-9948f507578d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.642513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e218365-3156-4d58-9899-9948f507578d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.682694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c2b7-34fe-4196-971f-d000921cf704 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.686697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.687478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.687763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.688068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.701662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.703100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:43.723172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:43.724178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:43.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 310/617] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:43.730595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.764686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.765379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.765673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.765959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.766360 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:43.766736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:43.767056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.768509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.797121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 308/618] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:43.805112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:43.843628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d613980-1497-4f68-9bf2-92f729bd61f3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:43.879355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:43.880051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:43.880338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:43.880661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:43.882143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:43.882462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:43.883878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:43.902670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 311/619] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:43.908080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.025173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df2f80-5ce8-4561-8e59-4b473dddb98c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.027672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.061964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.062901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.063187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.063464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.075132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.076628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:44.097411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:44.098476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:44.099365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:44.099365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:44.099365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:44.099365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:44.099365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 312/620] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:44.104256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.137135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be32445-755a-476f-a800-40034f7d5a54 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.146063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.201388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.203283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.204059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.205605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.227309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.230611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:44.254012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:44.254985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:44.255882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:44.255882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:44.255882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:44.255882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:44.258811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 309/621] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:44.264247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.330718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ebb0c-4f59-407c-bca6-3bdf9eeeb118 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.377480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.378069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.378358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.378638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.379359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:44.379666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.381069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e16a4-2096-46c7-b6e1-d79c2a8780d3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.400029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 313/622] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:44.401605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5609e-3842-48f5-a6a2-8e82fc18a359 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.401894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5609e-3842-48f5-a6a2-8e82fc18a359 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.402172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5609e-3842-48f5-a6a2-8e82fc18a359 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.403578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 314/623] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:44.404937 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5609e-3842-48f5-a6a2-8e82fc18a359 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.418140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.423091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8c8e7-c7e9-4fa3-82a6-0e5137b83ecc None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.459886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.460569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.460855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.461133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.461858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:44.462170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.463533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503c305-4bda-451e-8fba-504964bc040c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.475865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 310/624] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:44.477088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.477379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.477655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.493967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:44.495153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:44.504925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.535302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5609e-3842-48f5-a6a2-8e82fc18a359 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.568031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 311/625] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:44.568031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.597574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.598546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.598912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.599288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.610950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.612548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:44.629050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:44.630162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:44.631917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:44.637895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 315/626] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:44.638952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.696973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5785f6a-5d77-46aa-88fc-bc6755c62638 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.708106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.741581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.742881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.743340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.743909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.747725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab5114-8a99-47af-8b9a-d793e98fffd4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.753346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.754987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:44.774480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:44.775631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:44.776808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:44.779681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 312/627] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:44.780845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.785874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.791369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.792513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.793714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.794199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.806672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:44.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:44.816818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:44.817667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:44.826125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 316/628] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:44.827350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.905347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c069-ca9a-4269-ba6f-70ad72f1630d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.936436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae91e8-22cc-4cf8-a528-87565596831a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:44.949804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.950617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.951007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.951387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.952418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:44.952837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.954518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:44.966992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:44.973520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 313/629] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:44.974593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:44.977758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:44.978724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:44.979154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:44.979755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:44.981700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:44.982180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:44.983754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.006720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 317/630] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:45.008098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.044996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.093756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894a12e-b344-4744-bb88-ec849f30880f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.125744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732ccc-efd7-4832-8b5c-6a89b22af343 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.127878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.128579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.128867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.129139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.129888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:45.130198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.131589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.139990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 314/631] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:45.140742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.173061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.173868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.174334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.174443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/6f5ec849ef0e431d8ad7e84c94fac8c6/roles/194576b9361e47329a8c8682963953d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.189486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=6f5ec849ef0e431d8ad7e84c94fac8c6, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.191485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10191783-5733-4f17-8830-88aff6f601fd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 318/632] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:45 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/6f5ec849ef0e431d8ad7e84c94fac8c6/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743aac1-6bc2-4ae2-9097-59e94e951f12 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743aac1-6bc2-4ae2-9097-59e94e951f12 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743aac1-6bc2-4ae2-9097-59e94e951f12 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 319/633] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:45.211140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743aac1-6bc2-4ae2-9097-59e94e951f12 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.251622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.262444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b274a-1590-4a85-bd27-a9e22b478114 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.292582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.303025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.303739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.304215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.304341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.330799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743aac1-6bc2-4ae2-9097-59e94e951f12 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.373227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.374028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.374311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.374591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.388074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.389033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.389567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baa308-fd24-4f2b-ae34-e09192e1e4b1 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.390777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b5a6c238-8db5-4fa6-ae37-f74cc5432719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:45.410928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:45.411890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:45.412968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:45.412968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:45.412968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:45.412968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:45.412968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 320/634] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:45.413433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.414582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.414582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.430719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:45.431933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:45.499926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 315/635] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:45.501351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514d953-9787-45f2-aff7-10571d81e26e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.501644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514d953-9787-45f2-aff7-10571d81e26e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.501922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514d953-9787-45f2-aff7-10571d81e26e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.503343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 316/636] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:45.504167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514d953-9787-45f2-aff7-10571d81e26e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.509842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 321/637] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:45.511060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.531170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.544586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.616679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdecd6-43f0-4238-b515-b253c576d0d7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.643809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514d953-9787-45f2-aff7-10571d81e26e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.651978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.652806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.653089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.653363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.663523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.665000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.683681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-fc2d893d-f753-4ec2-9f3e-c6a609cc97c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:45.684224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:45.685288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:45.686372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:45.686372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:45.686372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:45.686372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:45.687050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.687476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.687891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.688781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:45.689240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.689903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 322/638] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:45.691239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.691411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.691703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.691997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.706793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 317/639] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:45.707823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.712286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:45.713480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:45.779692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.786030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 323/640] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:45.786829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.812296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:45.834347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d9e6-a506-4a60-8df1-af71fe68075d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.872655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.873464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.873752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.874037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.884954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:45.889780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf5d90-7449-4027-94ee-3228ce86435a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:45.893163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:45.894248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:45.895315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:45.897625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 318/641] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:45.898557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:45.927915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:45.929272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:45.929663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:45.930051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:45.930856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:45.931247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:45.932725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:45.950261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 324/642] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:45.950261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.010169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.015675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfb257-7d75-44e2-a28a-45f4e4e994d6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.050845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.051646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.051937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.052170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d32ab-f968-4a33-a33e-f9ed42b68156 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.052274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.060409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.062009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:46.077136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:46.078168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 319/643] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:46.079136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.089547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.093537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.094337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.094654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.094934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.106066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:46.113776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:46.114901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:46.117041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 325/644] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:46.120810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.188185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40417b-8de3-4797-8af3-a17df3720be8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.222802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.223393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.223681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.223992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.224745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:46.225593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.226959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.229906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8771c-3dcd-4b53-938a-1bf8f4427a2e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.239721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 320/645] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:46.239721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.253472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.272970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.273767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.274053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.274328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.282917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.284717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:46.299613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:46.300701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 326/646] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:46.301615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.319836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.358232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f9bcb-9971-4a5b-b6b3-bc6185f8ae88 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.394631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.395366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.395660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.395944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.396925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:46.397245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.398687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.408541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860ba07-6515-4c32-ae47-f46d02a9728f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.416429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 321/647] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:46.417328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.458741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.459442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.459735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.460059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.460816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:46.461126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.462488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.470923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 327/648] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:46.473050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.529702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc5669-1b7e-436a-aac5-617f919b06a8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.529942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.556535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.565709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.566766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.567040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.567321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.577459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.578910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.596793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52d4f-3bac-4573-8e46-da7be5a6b829 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:46.601909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:46.602991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:46.604238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:46.604238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:46.604238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:46.604238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:46.607654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 322/649] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:46.608510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.638348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.639006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.639294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.639688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.640620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:46.640938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.642429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.662125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 328/650] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:46.662125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.717829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cab48-bec9-42cc-9da9-775fa2f102a0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.752057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.752706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.752994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.753271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.760938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.765258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83825a-2f97-4419-9215-8d41024a3f35 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.802451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:46.802764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.803558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.803849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.804179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.815442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.817195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.831246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.832725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:46.835506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:46.836421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:46.837348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:46.837348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:46.837348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:46.837348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:46.837348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 329/651] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:46.837633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.942729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 323/652] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:46.945525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:46.953665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb6f8-bd6e-4ffc-a981-0da9f3a5fef3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:46.989336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:46.989994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:46.990276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:46.990576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:46.991305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:46.991612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:46.993082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.009345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 330/653] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.010509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.026900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.033142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.056308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62fc3-55b4-4bda-a7cc-363567e7b36b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.092938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.093599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.093884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.094160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.094987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:47.095302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.096780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.103991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 324/654] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:46 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.103991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.129654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e2c3-a852-442e-992d-5e2c2529cfa6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.179435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.180795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.181572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.182534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.183853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:47.184689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.187169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.211194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 331/655] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.211194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.241297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6c77-38cf-4fad-9c57-d039a490bc9f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.286642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.288583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.288865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.289038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.290496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.302480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.304543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.306481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.324471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cec9f-80bb-459c-b906-982cde44887c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:47.326929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:47.327913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:47.328985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:47.328985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:47.328985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:47.328985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:47.329227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 325/656] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:47.330366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.362011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.362818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.363106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.363386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.371324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.372801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-58567fc2-cac5-4c77-a703-66d4ec30c49d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:47.388072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:47.389046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:47.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 332/657] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:47.390635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440356-57ca-437a-84a1-765c9183ae06 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.391309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440356-57ca-437a-84a1-765c9183ae06 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.391309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440356-57ca-437a-84a1-765c9183ae06 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.392566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 333/658] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:47.396863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440356-57ca-437a-84a1-765c9183ae06 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.448461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016c3f-fccf-434e-96a4-0e2c36486f5c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.489175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.490405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.491376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.491659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.499543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.501017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.502711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440356-57ca-437a-84a1-765c9183ae06 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:47.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:47.517764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 08:57:47.518944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:47.524446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 326/659] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:47.525433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.537510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.544794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.545467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.545758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.546048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.546782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:47.547092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.548509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50bb38-99d7-4b2f-aab2-442b82bf15ee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.560458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 334/660] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.561638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.561932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.562216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.579669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:47.580897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:47.594164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.643811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347949-3107-42a0-955d-f7d78532eb52 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.655809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 335/661] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:47.656692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.695389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.696420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.696711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.696993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.697886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:47.698232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.699663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.721566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 327/662] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.721566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.773372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c784e-f9ea-4d79-9c83-269002e1e822 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.797353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.809842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.810523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.810812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.811091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.811935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:47.812286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.813714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.823673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a449ea-adec-4af4-a7e8-c8bf20d982af None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.831382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 336/663] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:47.832298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.841717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:47.867158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.867990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.868272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.868551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.875455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:47.876930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:47.891286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:47.892510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 328/664] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:47.893803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:47.943178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088dc2-37dd-471a-966b-60c1de1d9857 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:47.979565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:47.980384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:47.980668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:47.980941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:47.992747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:48.001068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef13bc-531d-4165-b73c-b35186d44200 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:48.003119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:48.004114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:48.005008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 337/665] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:48.005762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.047162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.047869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.048134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.048422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.051296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.092066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.115435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097195e-25fb-444e-ac1f-3f5251110032 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.121678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.123136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.150363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.151019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.151314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.151595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.220265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.221728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.230356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 329/666] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:48.230356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.264286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.303384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.331551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 338/667] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:48.331551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.341305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05417e-c063-41b4-98b6-011710e4760b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.378328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.379001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.379289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.379571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.380404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:48.380723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.382951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.399982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 330/668] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:48.399982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.435145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb20bd-ddf5-4db9-b225-24035af9b640 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.473654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.474321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.474607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.474909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.475661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:48.476003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.477375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.490082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 339/669] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:48.490877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.493436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.505526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003e654-3126-44e3-bde0-54c4ff9a6990 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.537198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.542385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.543257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.543656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.543934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.554939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.556346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:48.573980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:48.575056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:48.576125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:48.576125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:48.576125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.576125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:48.576125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 331/670] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:48.577074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.608601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972391-416c-4457-ae6c-01483a28a13f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.643890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.644733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.645021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.645299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.656673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.658117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:48.675334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:48.676347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:48.677547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:48.677547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:48.677547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.677547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:48.681629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 340/671] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:48.682027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.688438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa422b-27e4-4fd3-ad4d-72fc025f27b3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.725430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.726097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.726461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.726749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.727592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=bb4b2c43c8b74a2287730da251220971) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:48.727922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.729405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.735664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 332/672] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/role_assignments?user.id=bb4b2c43c8b74a2287730da251220971&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:48.736392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.752325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.794246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:48.824738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb498-d327-448a-94be-c5f0fd41118e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.855839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e924c-5582-4169-9da9-5b7662f41fbb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:48.864582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.866270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.866724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.867232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.880114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.882471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.897161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:48.898076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:48.898462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:48.898845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:48.899753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:48.900259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:48.901813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:48.902971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:48.904043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:48.905151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:48.905151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:48.905151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:48.905151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:48.905421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 341/673] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:48.906506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:48.917810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 333/674] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:48.918950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.031799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b565a-fadf-41b3-8a70-8ddda99301a3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.038925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27389ab-d9d4-468f-98f2-b8768ba36aea None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.041957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.048032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.077501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.078610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.079141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.079670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.080808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.081342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.083030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.089156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.089818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.090101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.090377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.091688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.092050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.093411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.097882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 334/675] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.099054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.107216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 342/676] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.108227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.211097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef573c-4e5d-469b-8dbc-93c4c64c26a2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.223134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46a88-6359-4859-a5ce-b9ffb6a2d2d5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.247737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.248583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.248874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.249158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.255948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.257460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.259264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.260192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.260479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.260757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.268443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.269878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:49.271659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:49.272703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 335/677] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:49.277103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-25aa6256-f8cb-4199-b99f-22ec859adfb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:49.285797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:49.286962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 343/678] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d970f-945a-4035-b9bb-0093f0cbdbf7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.293416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d970f-945a-4035-b9bb-0093f0cbdbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.294235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d970f-945a-4035-b9bb-0093f0cbdbf7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.294235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 344/679] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:49.294235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d970f-945a-4035-b9bb-0093f0cbdbf7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.317324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.320623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.395464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345034f-8574-43f6-9874-f28854dac547 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.395650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d970f-945a-4035-b9bb-0093f0cbdbf7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.430906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.431805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.432128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.432437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.433020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.433236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.433551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.434041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.434393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.434740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.435141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.442196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.443728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.452497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 345/680] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.452497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-15ea8bfe-5eb8-41da-be56-f8c1e5c9330d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:49.461645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:49.462792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:49.463920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:49.464929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 336/681] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:49.466142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.466482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.466814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.484036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:49.485476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:49.550355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.557325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 337/682] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:49.558328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.577470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.581742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba883c-c35c-46b5-afae-e408e406ceb8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.621998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.622699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.622988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.623265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.624142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.624464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.625883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.648108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 346/683] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.648108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.667705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094fe35-7dcc-4f33-888e-60b4ca60f590 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.703701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.704522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.704916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.705299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.706658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=06721172c3954f708ed5cae461e62961) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.707087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.708619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.723988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 338/684] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/role_assignments?user.id=06721172c3954f708ed5cae461e62961&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.723988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.790904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7819de-e462-40f5-93a1-77df4b0c93d6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.812922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.835504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bbb09-a680-4605-a406-bd8f67bcdbfb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:49.843242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.844630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.844924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.845209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.846034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:49.846885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:49.848881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:49.868145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 347/685] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:49.869230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:49.874997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:49.888415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:49.889380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:49.889769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:49.890150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:49.904501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:49.912307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:49.913473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:49.914520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:49.915985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 339/686] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:49.916963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.005970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d35d-64be-4e7d-83f4-e6fdeca99ee5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.045765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb6a77-babd-468f-a8fa-f01a313e0eb5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.049145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.049816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.050107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.050384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.084906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.085571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.085856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.086132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.086971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=13efde93abb94f78b4cf7b2df191136a) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:50.087285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.088759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.095997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 340/687] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/role_assignments?user.id=13efde93abb94f78b4cf7b2df191136a&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:50.100887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.118876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.167714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.169483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.179110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.306922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab236-e3f1-4804-8942-7b7150afbd0f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.318149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 348/688] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:50.323804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.354503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.355928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.356492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.357054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.358017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:50.358550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.360165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.371141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 341/689] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:50.378346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.437203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1ba87-0909-41fb-849a-138fc74fb706 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.440366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.455452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.482880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.483691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.483998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.484297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.494512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d74341-506a-4686-b687-127b91794de6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.497868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.498774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:50.518212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:50.519184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:50.520800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:50.520800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:50.520800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:50.520800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:50.520800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 349/690] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:50.524724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.548653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.549468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.549798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.550080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.572775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.575127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:50.610078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:50.611059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:50.612023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:50.612023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:50.612023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:50.612023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:50.612023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 342/691] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:50.618243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.680101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa100-c713-4c60-8886-01e371633e34 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.716024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.717037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.717547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.718029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.718974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:50.719500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.721090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.733922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 350/692] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:50.741668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.762829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.807629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ca26-5acf-4e02-9d5a-7694dc1048a4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.829751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:50.846596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.847255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.847537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.847816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.849405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:50.849721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.851629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.878422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 343/693] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:50.887461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:50.905980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42513e29-9e18-4826-afcc-9d3c0d9b0bbe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:50.945482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:50.946613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.947249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.947711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.958169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:50.960007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c6279a1f-fe95-4645-9528-7ce532cd8e40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:50.978565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:50.979502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:50.980462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:50.982527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 351/694] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:50.983652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997c03-eb99-4c65-a3c0-a2931d119884 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:50.983944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997c03-eb99-4c65-a3c0-a2931d119884 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:50.984251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99997c03-eb99-4c65-a3c0-a2931d119884 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:50.985900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 352/695] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:50.992806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99997c03-eb99-4c65-a3c0-a2931d119884 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.049957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b5ed2-bdcb-467c-85b0-2a59011a711d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.093759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.094806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.095735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.096437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.097123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.106902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.108982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.123905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99997c03-eb99-4c65-a3c0-a2931d119884 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d141f1ad-72e0-473e-84d1-1bd776c19a43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:51.124708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:51.125636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:51.126608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:51.129225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 344/696] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:51.130714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.131259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.131739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.150481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:51.152156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:51.185482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.186206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.186497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.186780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.187902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:51.188251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.190510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.206867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.208038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 353/697] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:51.209152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.256070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 345/698] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:51.257297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.335741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109acb5-8ddc-431a-a221-9d65beb53a5a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.380423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.382196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.382692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.383356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.384725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:51.385047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.386467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.389037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.400247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96441d8a-5786-4b2e-910e-14740260d210 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.405904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 354/699] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:51.406838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.438111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.439095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.439627 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.440267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.441666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=6f5ec849ef0e431d8ad7e84c94fac8c6) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:51.442187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.444373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.451289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 346/700] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/role_assignments?user.id=6f5ec849ef0e431d8ad7e84c94fac8c6&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:51.452333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.495709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.517434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112c1e-b3da-4cf3-940f-667ba849d8a3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.607985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.607985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.607985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.607985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.608422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.608422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.637844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7345d0-0a9f-471e-aaea-103c9d5b20e9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:51.642584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:51.643558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:51.644450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:51.648086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 355/701] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:51.653543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.681391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.682172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.682577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.682863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.734759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.770247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.771773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.791042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b63e-3dbf-4512-8f56-6f8e79fb9c98 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.806606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:51.835366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:51.836220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:51.836510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:51.836792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:51.837858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:51.838321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:51.840000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:51.848111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 356/702] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:51.858006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.890612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 347/703] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:51.895604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:51.969311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e24b6-074c-4ead-a84d-26730ba6a28a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:51.992953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.004513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fb5c3-aafb-4c5f-81b8-64b5be38251a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.005277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.005941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.006800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.007086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.007805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:52.008165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.009686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.022622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 357/704] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:52.049246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.050474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.050953 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.051438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.054577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.067338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.069839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f8d86b52-63e7-4f33-97ca-c2bf9c00f78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:52.090262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:52.091243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:52.092221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:52.092221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:52.092221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:52.092221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:52.094428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 348/705] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:52.099706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.209688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463ef-f21c-4d21-84e1-bb52933052ae None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.210222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463ef-f21c-4d21-84e1-bb52933052ae None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.210684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75463ef-f21c-4d21-84e1-bb52933052ae None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.212626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 349/706] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:52.227498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f05d6-14cd-4899-b615-e17045313eab None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.228054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f05d6-14cd-4899-b615-e17045313eab None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.228481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f05d6-14cd-4899-b615-e17045313eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.233538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087da8-4ba5-454f-aa1f-66b24780eb7c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.256198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-908f05d6-14cd-4899-b615-e17045313eab None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:52.258390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-908f05d6-14cd-4899-b615-e17045313eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:52.270557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.270861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.271148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.271422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.272316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:52.272931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.274088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.291092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 358/707] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:52.296495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.356941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.364092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 350/708] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:52.388818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f05d6-14cd-4899-b615-e17045313eab None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.451046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a266f2-c463-4354-b9fe-6bae6d582968 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.494624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f05d6-14cd-4899-b615-e17045313eab None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.513165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.532642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.533405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.533688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.534011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.544699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.545508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.545793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.546068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.546264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.547728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.560096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.561548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:52.567313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:52.568271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:52.569257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:52.569257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:52.569257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:52.569257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:52.569257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 351/709] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:52.577451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:52.607357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:52.609045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:52.609948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 359/710] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:52.614443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.744094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473280-8183-4388-a9e8-fb6da3beb9ab None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.751859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.760345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e456-e644-48cd-9f8f-e261f08c11cf None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.780768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.781438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.781738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.782006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.782858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:52.783117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.784584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bc850-bb22-4cb7-906b-17ec9d263d05 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.798160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 360/711] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:52.799481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05649a-7a5a-4a09-972b-2c91de2cb101 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.799770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05649a-7a5a-4a09-972b-2c91de2cb101 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.800075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05649a-7a5a-4a09-972b-2c91de2cb101 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.801567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 361/712] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:52.803729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05649a-7a5a-4a09-972b-2c91de2cb101 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.807208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.808683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.812266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.812743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.814258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:52.814781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.817084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9664f-0dd6-4cf5-a81d-d0da7b33aa06 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.835176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 352/713] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:52.837278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.837734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.838162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.859252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:52.861403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:52.892006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:52.930396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05649a-7a5a-4a09-972b-2c91de2cb101 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:52.938442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 353/714] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:52.939450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:52.971522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:52.972559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:52.973001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:52.973451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:52.974541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:52.975095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:52.976894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:52.984581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 362/715] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:52.985741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:53.023262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:53.047000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298763-3efc-4d82-8cb5-8598de964b81 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:53.084006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:53.085454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:53.085991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:53.086498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:53.087331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:53.088971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:53.110775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6151d-17f3-4662-890e-211cc1edb1a3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:53.113403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 354/716] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:57:52 2022] POST /identity/v3/users => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:53.154001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:53.155133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:53.155575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:53.156035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] PATH_INFO: `/v3/services/network` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:53.156897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:53.158589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:53.172449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:53.173807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:53.174918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:53.177729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 363/717] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:52 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:53.183842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:53.216217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:53.318108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ecb9a-fcc0-4726-8f80-cd14651c47e1 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:53.354685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:53.355369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:53.355654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:53.355936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:53.356692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] RBAC: Adding query filter params (name=network) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:53.357069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:53.358498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc319c-a4c4-49bd-82e3-a6c69e8e1f57 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:53.363739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 355/718] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:57:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:53.369605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:53.484120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:53.492909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58986-63ca-454b-b7a3-1b2d28557265 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:53.529694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:53.530709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:53.531215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:53.531702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:53.532687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:53.533224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:53.534790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a24da-b8f5-4236-b1e9-478974a3e1a4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:53.540125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 364/719] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:57:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:54.460240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b13c0-b4e1-40b2-a4aa-2e63e48fe466 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.460793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b13c0-b4e1-40b2-a4aa-2e63e48fe466 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.460793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b13c0-b4e1-40b2-a4aa-2e63e48fe466 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.466018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 356/720] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:54.471814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.472298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.472502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.492337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:54.493514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:54.561001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e023-2e68-441f-830f-b42477f558c6 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.561396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e023-2e68-441f-830f-b42477f558c6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.561591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2e023-2e68-441f-830f-b42477f558c6 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.563056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 357/721] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:54.579090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 365/722] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:54.581022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.581308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.581584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.607306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:54.615313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:54.616586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:54.748160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 358/723] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:54.754834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:54.773057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ddf7a-5e79-4bef-b482-203e9d00812c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:54.783288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:54.794375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:54.852667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:54.853481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.853767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.854046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.876781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:54.896518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:54.897717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:54.898754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:54.902959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 366/724] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:54.909065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:54.917082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfd23f-55f4-4e12-8738-87eb741695bb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:54.957770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:54.958443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:54.958730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:54.959004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:54.959775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:54.961169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:54.998378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 359/725] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:57:54 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:55.103897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3291c-d632-469d-a2d3-af72be7795e4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:55.170875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:55.171519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.171805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.172116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.172877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:55.173189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:55.174564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:55.184886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 367/726] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:55.189994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.266753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:55.305136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f2b32-5442-463e-b103-899fefda9fb7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:55.340979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:55.341784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.342063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.342347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.353670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:55.355153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-37eb0f4e-9151-4de3-809d-3ec6ced50f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:55.373390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:55.374334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:55.375803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:55.375803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:55.375803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:55.375803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:55.375803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 360/727] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:55.380093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.392623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:55.517426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7da81-5d29-4ed9-bd87-3e8a8190a62c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:55.535214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57562-0a3b-4790-9aa7-2f926c15649e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.535738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57562-0a3b-4790-9aa7-2f926c15649e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.535825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57562-0a3b-4790-9aa7-2f926c15649e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.537265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 361/728] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:57:55.543169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.543460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.543739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.574990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:55.576945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:55.583783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:55.583783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.583783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.583783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.584201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:55.584201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:55.584201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:55.607754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 368/729] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:55.612855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.687203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:55.727114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396ae30-15bd-4858-8a60-0abe3edb7e67 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:55.741649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 362/730] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 08:57:55.765007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:55.765812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.766151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.766434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.772877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.786695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:55.788940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:55.808655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:55.809671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:55.810834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 369/731] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:55.817192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.842167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:55.899129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4f6b-0307-469a-a175-01ac3297a1cf None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:55.938696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:55.939490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.939774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.940077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.962078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ca4be208-8687-4a6e-af95-b474feea5703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:55.969975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:55.970914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:55.972385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 363/732] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:55.973088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669173-3657-42dd-bc19-1a9186d4a490 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:55.973156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669173-3657-42dd-bc19-1a9186d4a490 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:55.973415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669173-3657-42dd-bc19-1a9186d4a490 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:55.979222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 364/733] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:55.979222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24669173-3657-42dd-bc19-1a9186d4a490 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:55.985993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ab54-2306-4784-86ec-32af12f99451 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.016056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.027241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.027990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.028395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.028775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.029793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:56.030203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.031790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a426fff-6d41-45f5-bb59-46f224bd32b0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.058387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 370/734] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:56.058387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014939-35bb-41e2-8684-f178feec5463 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.058387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014939-35bb-41e2-8684-f178feec5463 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.058387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15014939-35bb-41e2-8684-f178feec5463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.076073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-15014939-35bb-41e2-8684-f178feec5463 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:56.077433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-15014939-35bb-41e2-8684-f178feec5463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:56.126096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24669173-3657-42dd-bc19-1a9186d4a490 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.141271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.149304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 371/735] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:56.150101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014939-35bb-41e2-8684-f178feec5463 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.179721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.180478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.180734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.181015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.181766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:56.182081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.183548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454864a3-9022-47bb-b08c-ab9c3d870a5e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 365/736] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbb11-b56f-4ade-9d65-557de73be464 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbb11-b56f-4ade-9d65-557de73be464 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dbb11-b56f-4ade-9d65-557de73be464 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 366/737] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:56.196185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dbb11-b56f-4ade-9d65-557de73be464 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.274918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15014939-35bb-41e2-8684-f178feec5463 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.290386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.308431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dbb11-b56f-4ade-9d65-557de73be464 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.312592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.313217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.313507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.313790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.345754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.346559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.346896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.347176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.358925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:57:56.366898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:56.367922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:56.368821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 367/738] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:56.369537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.391552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.393049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b03bb-44b6-412c-bf00-afa8ab0ede18 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.403621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.479019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad037bc0-e6dc-42b0-988f-b7174a6e77b3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.496723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 372/739] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 08:57:56.498289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.498590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.498874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.517080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:56.518124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.518347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:56.518950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.519234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.519514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.530715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.532538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.534007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:56.552261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:56.554278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:56.555373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:56.555373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:56.555373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:56.555373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:56.558622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 368/740] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:56.559331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.604276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 373/741] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 08:57:56.605693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.651174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.669760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689309c-d2a3-4d05-9886-a76a829fb51a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.705619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.706270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.706551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.706824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.707231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51470f4-666f-42eb-895f-8e868f197a94 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.707567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:56.707879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.709516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.722130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 369/742] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:56.722839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.742448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.743230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.743514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.743793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.753963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.755431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.758263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:56.774948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:56.775843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 374/743] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:56.781951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.840253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01d3ee-28f6-487e-bb97-01262e8b1345 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.874834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.875500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.875786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.876096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.876827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:56.877142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.878505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.888671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55b4d1-78a5-4e30-9c88-e8e4b9165f2e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:56.890150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 370/744] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:56.890949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:56.900666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:56.937328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:56.938103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:56.938768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:56.939142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:56.939944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:56.941677 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:56.956047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 375/745] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:57:56 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:57:56.956947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.025036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.032517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a271c-7766-4dbc-8ee1-f865787f5069 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.082824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b21e3-6be8-493f-8b9a-5803a7ce982e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.088594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.089687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.090156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.090704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.105417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.107027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:57.129290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:57.130285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:57.131234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:57.131234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:57.131234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:57.131234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:57.138097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 371/746] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:57.138097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.140196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.141001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.141325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.141682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.142439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:57.142755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.144657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.160151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 376/747] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:57.160151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.220375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.265370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b0f4-be21-422c-a895-986a2dfe854f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.288893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9578599-7133-4fe2-b111-c79f3c0a69ef None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.300477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.301501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.301929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.302348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.305912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.310526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.312668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:57.330353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:57.331557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:57:57.332748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:57.333400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.333400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.333817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.334692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.335499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:57.335977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.336423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 372/748] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:57.337508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.337682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.366192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 377/749] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:57.366192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.469079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110901-e2d3-49a8-b2eb-176270483d54 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.486275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11550-ed81-49e1-ade1-5439498512ae None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.487273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.509497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.510737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.511021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.511293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.518047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.519469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.524923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.526145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.526651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.527005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.527860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:57.528225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.529662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc5aef-d079-4be3-917a-281018163242 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:57.534704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:57.535565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 373/750] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:57.541582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 378/751] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20deb3-0ddd-4753-a955-fe210285718c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20deb3-0ddd-4753-a955-fe210285718c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20deb3-0ddd-4753-a955-fe210285718c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 379/752] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:57.559125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20deb3-0ddd-4753-a955-fe210285718c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.596285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.652011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83047f-eea2-4adb-9aa9-527e6226c594 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.672441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20deb3-0ddd-4753-a955-fe210285718c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.687178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.688096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.688392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.688665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.696639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.698067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.708530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.709743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.710032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.710375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.711176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:57.711490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.712948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bee155-37da-4aee-9f1f-68750588e32b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:57:57.714193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:57.715103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 374/753] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:57.716157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.736577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 380/754] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:57.736577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.736577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.736577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.750109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:57.751302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:57.760721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.827214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 381/755] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:57:57.828089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.844835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6fe8d-9285-4022-af54-7228c09fdd95 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.849290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:57.884386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.885179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.885465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.885746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.896381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.897878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:57.915686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:57.916647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:57.917551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:57.917551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:57.917551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:57.917551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:57.917551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 375/756] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:57.917828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:57.946392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6f6db-b834-413b-9352-d5ebe5c3d9d3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:57.983276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:57.983993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:57.984289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:57.984572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:57.985812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:57.985812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:57.987138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.005842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 382/757] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.006239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.006695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.027123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cba98b-1540-45e6-bc04-ce2981acdd26 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.064587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.065245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.065535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.065823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.066921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=6f5ec849ef0e431d8ad7e84c94fac8c6) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:58.067240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.068733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.074265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 376/758] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:57 2022] GET /identity/v3/role_assignments?user.id=6f5ec849ef0e431d8ad7e84c94fac8c6&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.075095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.113149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.136195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6296-5f9f-44f2-8789-065071ee13e2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.179175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.180133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.180517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.180898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.181705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.183240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:58.197888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:58.199120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:57:58.200001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:58.201217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 383/759] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:58.201576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.228449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc097-ac27-4023-ab78-599e001e3af9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.274864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.275530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.275813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.276117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.276848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:58.277162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.278539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.299128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 377/760] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.300671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.314194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.319427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425712f-ce16-4192-8410-359724c7af99 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.354771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.355426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.355709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.356041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.368133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.425414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.426826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb50d-a704-4593-b916-5fda2b34479c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.426940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.465267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.466279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.466826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.467306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.468238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:58.468794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.470448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.476204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 378/761] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.477391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.542085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 384/762] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:57:58.543013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.562889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.592872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b550be-31ab-4104-9e2e-a17f05b8ca12 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.594804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.633194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.634396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.634876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.635434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.643125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.644942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.658784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854b7d3-27c5-4f7a-8e7c-28c23a863fac None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:58.661224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:58.662457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:58.663343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:58.670046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 379/763] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:58.671103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.695307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.696125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.696309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.696556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.697270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:58.697581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.698946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.704421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 385/764] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.705326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.779499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60590c5f-1e65-4346-aa2a-c30c93934e27 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.809976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcd6d-6a31-4bcb-8c31-3e67f8ab855c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.816694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.817746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.817925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.819384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.819942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.822649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:58.833812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.836200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.851091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:58.851761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:58.852079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:58.852368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:58.853168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:58.853483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:58.854928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:57:58.857942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:58.858823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:58.859746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:57:58.859746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:57:58.859746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:57:58.859746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:58.862014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 380/765] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:58.863090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.876014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 386/766] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:58.876014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:58.973655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9ca67-e03d-4226-80e7-4537d6d54d33 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:58.977036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b723-aac0-4894-bb7f-cb70fe1732ba None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.009679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.010886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.011347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.011452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.011937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.012276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.012631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.013026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.013501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] RBAC: Adding query filter params (interface=public, service_id=20c4a4667a024c76b989911c3ab69346, region_id=RegionOne) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:59.013882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:59.014181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.014281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.015708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.016004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.025026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 381/767] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/endpoints?service_id=20c4a4667a024c76b989911c3ab69346&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:59.026193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.029038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 387/768] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:59.034295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.064560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.080336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.140503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c8ae-4793-4f03-b88d-47332d1387e0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.178891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.179580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.179867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.180177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.180886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.182297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.192018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 388/769] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:59.192018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.260973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a584-9698-4166-94db-e433b6f3e8b6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.315309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.315309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.315309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.315309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.315715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=b8fc0436447946d6b65f0ec3880a0c38, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.315715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732ba3-9cd6-4d70-b59e-04284847cc2e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.318319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.331828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88728-3ba3-4d2d-b967-e8291b3817b6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.337542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 382/770] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:57:59 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:57:59.339183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed92-ad41-4e5b-b687-7740bd25d185 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.339660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed92-ad41-4e5b-b687-7740bd25d185 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.340189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed92-ad41-4e5b-b687-7740bd25d185 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.342122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 383/771] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:57:59.351752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.351752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.351752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.373224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:57:59.374518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:57:59.400195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.401343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.402530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.403050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.414677 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.416797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:57:59.440957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:59.442200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:57:59.443122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:57:59.446753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 389/772] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:57:59.452624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.466704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 384/773] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:57:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:57:59.490170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.543393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.598735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de5076-2e2b-448f-9d11-cad990fd2bc9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.622512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796a53-89a9-4802-b6b4-b7a0cabc3416 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.644773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.645944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.646775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.647213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.648298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:59.648792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.650942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.667093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.668084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.668503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.668873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.669067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 390/774] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:57:59.669728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.671168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.681010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:57:59.689560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:57:59.690550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:57:59.692090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 385/775] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:57:59.697881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.713756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.813037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15701ca-0731-4b31-8429-a3c25b2643d7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:57:59.815848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:57:59.853664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:57:59.854260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:57:59.854549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:57:59.854827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:57:59.855550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] RBAC: Adding query filter params (name=network) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:57:59.855866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:57:59.857426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:57:59.862667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 386/776] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:57:59.868782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:57:59.983863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146e7b-c325-49d9-b6de-b312bf3c34ec None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.017899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68aa11-2c68-4a3b-a72f-02b239fbdced None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.022836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.023518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.023801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.024121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.024843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] RBAC: Adding query filter params (type=network) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:00.025155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:00.026978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:00.033758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 387/777] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:00.039925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:00.073014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:00.109715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.110306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.110598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.124049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.125062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=baa89e3c59b641fe89fcc36f75ee396c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:00.125396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:00.126865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:00.136511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 391/778] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:57:59 2022] GET /identity/v3/role_assignments?user.id=baa89e3c59b641fe89fcc36f75ee396c&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:00.153657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a070ed-4545-4694-9716-bfafa8230c8a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.192370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.193059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.193426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.193716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.194543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] RBAC: Adding query filter params (interface=public, service_id=4e661c637e194b5fa9399001479d25c9, region_id=RegionOne) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:00.194865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:00.196304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364db06-3f41-4201-9500-d98c61cbc860 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:00.202951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 388/779] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:00 2022] GET /identity/v3/endpoints?service_id=4e661c637e194b5fa9399001479d25c9&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:00.208519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:00.265484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989094-fc28-4832-8953-6771262ee8e3 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.266148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989094-fc28-4832-8953-6771262ee8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.266644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989094-fc28-4832-8953-6771262ee8e3 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.269715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 389/780] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:00.275173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.275767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.276281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.295589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:00.297653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:00.342273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:00.372095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea18c7-0c7f-40e5-b9c4-f328949c13bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.384088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 390/781] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:00.407260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:00.419055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.420121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.420618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.421102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.421999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:00.424486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:00.430462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 392/782] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:00 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:00.443025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:00.536663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc100384-2ab1-469b-8f51-f7db28425681 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.579376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.580610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.581137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.581621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.603033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:00.611499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:00.612567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:00.613428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:00.621427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 391/783] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:00.628089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:00.750047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858195-e6a9-420e-85e9-838c81623c7c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.789763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.790457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.790743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.791020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:00.791800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:00.792142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:00.793543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:00.799404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:00.805032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 393/784] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:00.810795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:00.936562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:00.956574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223771c-be17-45c6-8519-de32d273cb23 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:00.991692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:00.992887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:00.993378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:00.993859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.005227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:01.007573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:01.029288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:01.030198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:01.031126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:01.031126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:01.031126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:01.031126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:01.037649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 392/785] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:01.039331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:01.172978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b1830-cf8a-4f8f-8152-a90dd743c79c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:01.219530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:01.220140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.220429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.220704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.221432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:01.221740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:01.223093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:01.238552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 394/786] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:01.244983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:01.370935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45408ced-ca5d-40dc-a289-7c36a930fb21 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:01.416370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:01.417546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.418039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.418547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.431613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:01.433440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:01.435614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:01.456531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:01.457537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:58:01.458501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:01.461220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 393/787] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:01.467477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:01.551334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:01.615843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863f78-86a4-49a4-9692-7b9009c63aea None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:01.669697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:01.670446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.670642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.670927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.671768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:01.672107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:01.673539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652ec88-d36a-45cb-b8e2-cb70af0df89c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:01.712351 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 395/788] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:58:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:01.718078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:01.866312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718c4b-054a-453c-8479-38887c1f1d52 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.866505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718c4b-054a-453c-8479-38887c1f1d52 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.866771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44718c4b-054a-453c-8479-38887c1f1d52 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.868391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 396/789] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:01.874549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cbbc-2fdc-4d9b-b140-8748ee7accfd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.874836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cbbc-2fdc-4d9b-b140-8748ee7accfd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.875115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700cbbc-2fdc-4d9b-b140-8748ee7accfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.875644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fc66-a75b-465f-93c4-80500b305fc2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:01.910606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c700cbbc-2fdc-4d9b-b140-8748ee7accfd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:01.916791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c700cbbc-2fdc-4d9b-b140-8748ee7accfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:01.961542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:01.968084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:01.969127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:01.969638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:01.984779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:01.987162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.008281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 397/790] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-bb2bbfa5-674e-4b60-9f1a-63b8e4e898fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:02.009085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:02.009978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:02.010915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:02.010915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:02.010915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:02.010915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:02.011140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0209bf6-15d7-42c7-b6e9-7e47c00e79f8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.011140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0209bf6-15d7-42c7-b6e9-7e47c00e79f8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.011140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0209bf6-15d7-42c7-b6e9-7e47c00e79f8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.011856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 398/791] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:02.018002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 394/792] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:02.019396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0209bf6-15d7-42c7-b6e9-7e47c00e79f8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.023377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.023887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.024390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.044895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:02.046100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:02.092580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.098908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.128456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 395/793] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:02.129265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.180913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0209bf6-15d7-42c7-b6e9-7e47c00e79f8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.218791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.219456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.219741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.220061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.220789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:02.221099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.222594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.234920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 399/794] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:02.236170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.249619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195abac-e27d-4772-88ad-e1b2191307dc None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.284848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.285835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.286235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.286610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.299373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:02.308070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:02.309219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:02.310320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:02.316467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 396/795] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:02.318967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.356000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7293cb7-9fdb-4fdb-9634-70fa7875bb36 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.363034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.368352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.400443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.401349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.401730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.402114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.402860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.404340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:02.419418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:02.420595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 08:58:02.421450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:02.422601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 400/796] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:02.422759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.436225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18948d08-3358-4fa8-a8fc-be533f196b02 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.477720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.478891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.479185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.479472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.488641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.490089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:02.509741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:02.510732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:02.511639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:02.515819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 397/797] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:02.516686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.549817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4afecc-8f90-4239-bf5a-f3397986cfe9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.598585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.601578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.601880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.602250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.603107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:02.603487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.605050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.614661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 401/798] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:02.616148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.642977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.646207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca062f-e0bc-4dcf-9191-d81acbfbae4e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.654996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.683865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.684567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.684966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.685254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.685972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:02.686525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.687653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94417394-9ea4-4b6b-93cb-68546e88d205 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 398/799] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef54f-73d8-4faa-a38d-96abf40e84dc None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef54f-73d8-4faa-a38d-96abf40e84dc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef54f-73d8-4faa-a38d-96abf40e84dc None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 399/800] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:02.696784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ef54f-73d8-4faa-a38d-96abf40e84dc None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.735673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2d845-4134-4352-a3cb-601b1f295f67 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.773680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.775078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.775373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.775656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.776529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:02.776847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.778275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.796603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 402/801] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:02.796603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.815610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ef54f-73d8-4faa-a38d-96abf40e84dc None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.852222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.853024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.853307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.853587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.864322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.866731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-576488e6-7125-43ac-9d48-1157e12e6539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:02.884295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:02.885758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 400/802] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.887087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.887497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.896238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.904337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a34f4-5b6a-4c27-9eff-05f51f2443d9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:02.904785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:02.906027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:02.918260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:02.941699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:02.942590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:02.942883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:02.943166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:02.944134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:02.944456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:02.946656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:02.956795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 403/803] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:02.956795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:02.977524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 401/804] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:02.978371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.066974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91998d0e-dd7d-4b3c-8cbe-65da09c2b09a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.089841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bcaf0-d204-4850-bc1f-38c8c41bd8ef None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.101037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.101926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.102214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.102494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/6f5ec849ef0e431d8ad7e84c94fac8c6/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.104508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=6f5ec849ef0e431d8ad7e84c94fac8c6, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.105945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.119150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 404/805] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:02 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/6f5ec849ef0e431d8ad7e84c94fac8c6/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:58:03.119915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.124038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.124717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.125001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.125277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.126019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:03.126327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.127729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.141000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 402/806] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:03.141877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.153316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.165342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.255872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0358a-c62d-447c-b0c7-957b9c9c7e1e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.256253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296a276-1ad6-4900-b005-7a79d15d089d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.299108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.299888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.300293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.300635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.301104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.301390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.301911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.302199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.302480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.302789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417798-cdd8-4d7f-ab17-dac50189d05a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.313754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:03.322360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:03.323318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:58:03.328043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.330466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 405/807] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:03.330547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 403/808] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:03.330547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.330673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a153a-7039-4887-861d-e625ab9c5a1b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.330673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a153a-7039-4887-861d-e625ab9c5a1b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.330673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a153a-7039-4887-861d-e625ab9c5a1b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.330673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 406/809] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:03.333043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.333376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.333618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.354750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:03.356118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:03.438933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.442854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.452745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 407/810] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:03.454726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.495439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551da08-506f-4c13-9d1e-4199cfb5bafd None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.535695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.536821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.537175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.537549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.546183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.547787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:03.562241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:03.563235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:03.564236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.567124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 404/811] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:03.571976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.603572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e2f0-1b77-4386-9682-37363a775bd5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.642432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.643625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.644140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.644638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.645701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:03.646317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.648521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.658047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 408/812] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:03.659301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.677997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d351c-fb5f-453e-ab28-9e871c77f058 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.705067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.714744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.715606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.715902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.716205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] PATH_INFO: `/v3/services/network` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.716931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.718301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:03.730190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:03.731195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 08:58:03.732127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.734848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.736066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 405/813] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:03.737092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.781083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c8f2b-1017-41b4-a4c8-0880393957db None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.819867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.821015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.821614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.822097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.823240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:03.823756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.825546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.841035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecd23-e9e4-4111-9799-3d108920c760 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.850425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 409/814] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:03.851774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.878801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:03.879606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:03.879896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:03.880243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:03.892005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:03.893438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:03.912084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:03.913049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:03.913975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:03.913975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:03.913975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:03.913975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:03.913975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 406/815] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:03.914665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:03.959925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:03.968817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a9e4e-6c16-489a-8caa-f430168b2d79 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:03.991852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.008935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.010031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.010638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.011133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.012080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] RBAC: Adding query filter params (name=network) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:04.012713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.014386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.019161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7afbf9-b7ff-4194-b527-04de64911cad None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.020149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 410/816] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:04.021135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.059474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.059815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.060140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.060420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.140686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.142153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.146321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f214-caef-45c0-a5a0-e0b9b42cd30b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.190786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.193184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.194971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.195415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.196469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.197221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:04.197540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.198933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.211095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 411/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:04.211848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.262880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.276070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 407/818] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:04.277577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.323784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189cb43-cf5c-4ef3-9886-a88fdd9054e0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.359225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.360096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.360608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.360986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.361802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] RBAC: Adding query filter params (type=network) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:04.362216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.363760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.374158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 412/819] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:04.375131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.385652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4d99-7f4e-453b-aeee-2b0db4b9f122 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.421844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.422801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.423100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.423387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.431415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.433011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:04.449079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:04.450217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:04.451374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:04.454915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 408/820] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:04.455730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.460250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.483576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa389d0-d5a7-4e3e-863e-3352f036ea8b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.495066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.522353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.523308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.523720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.524139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.535870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.538028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:04.556228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:04.557306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:04.558403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:04.558403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:04.558403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:04.558403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:04.563973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 413/821] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:04.563973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.576269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22c12-4af6-46e8-9539-3204d26414b2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.615526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.616599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.618468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.618964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.620021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.621766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.652343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 409/822] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:04.653874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.684758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00dda3-8e5c-4301-925f-bfffe5e54321 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.728366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.729407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.729794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.730173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.731131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:04.731543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.733114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.752411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 414/823] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:04.757909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.772410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.783221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:04.822873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4abef3-4123-471c-90d2-88aa4fc79b73 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:04.869835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:04.870809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:04.871498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:04.872437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:04.873613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:04.874271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:04.878192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:04.905603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 410/824] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:04.911927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:04.956887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2cfc9-fd09-4480-9516-603dc0903b22 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.008785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.010087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.011763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.012291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.026001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.028251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:05.054224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:05.055177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:05.056091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:05.056091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:05.056091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:05.056091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:05.056752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56908e-f51a-41e7-b8a9-d870d1bf9f9b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.058663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 415/825] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:05.064148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.078373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.096978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.098254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.098738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.099213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.106915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.108779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:05.123934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:05.124917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:05.125810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:05.128403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 411/826] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:05.135567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.154044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.208838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867553a-b411-4f3d-bbe4-02ca826d1ef5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.255500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.256816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.257101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.257380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.258111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:05.258421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.259925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a4451-9d08-45e6-ba2c-1b4fa6abc0bc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.272774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 416/827] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:05.277225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170768d-44e5-4cdf-b789-e6030cd522f5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.277345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c149e27-24ed-40ed-8111-e64e1c582d2a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.277427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170768d-44e5-4cdf-b789-e6030cd522f5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.277427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170768d-44e5-4cdf-b789-e6030cd522f5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.277427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 417/828] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:05.278727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170768d-44e5-4cdf-b789-e6030cd522f5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.315882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.316954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.317239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.317648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.319022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:05.319334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.320886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20866-7186-44c5-994e-ef89a3ef52e1 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.339736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 412/829] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:05.339736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.339736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.339736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.354913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:05.356125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:05.389016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.431744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 413/830] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:05.433438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.503035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170768d-44e5-4cdf-b789-e6030cd522f5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.529206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.538636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.539242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8f4d1-e27e-440f-bcb5-4daeae2abcfe None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.539432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.539722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.540029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.547933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.550077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:05.564318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:05.565334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 418/831] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:05.571947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.576012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.576663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.576946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.577228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:05.578384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.579800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c1929-9500-4f5f-a4a5-7e6821be19e7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 414/832] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b636a-e5a6-466b-9107-4f0126a07e02 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b636a-e5a6-466b-9107-4f0126a07e02 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b636a-e5a6-466b-9107-4f0126a07e02 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 415/833] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:05.595987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b636a-e5a6-466b-9107-4f0126a07e02 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.625770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.710473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d4abb-4c21-4058-ab79-544de1c150fa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.713482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b636a-e5a6-466b-9107-4f0126a07e02 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.750645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.751015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.751187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.751294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.751575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.751856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.752163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.752439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.753234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:05.753547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.754968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacf9e4-aeaf-48e9-a532-c75e6ae69c7a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.765480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:05.767039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 416/834] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:05.768332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.768619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.768900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:05.774117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:05.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:05.775907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 419/835] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:05.776730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.788676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:05.789815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:05.832497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.865996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 417/836] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:05.867073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.895177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d98ba-96ff-4836-bb52-b91a3c9d26f8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:05.897270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:05.934484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:05.935383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:05.935673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:05.935968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/baa89e3c59b641fe89fcc36f75ee396c/roles/194576b9361e47329a8c8682963953d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:05.951883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=baa89e3c59b641fe89fcc36f75ee396c, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:05.953392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:05.971986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 420/837] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:05 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/baa89e3c59b641fe89fcc36f75ee396c/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:58:05.971986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:05.982042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b2b11-4623-4182-b113-d45fa07acd82 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.025321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.026192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.026581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.026967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.027900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:06.028408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.029955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.041176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 418/838] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:06.047034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.109604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.116314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410498e5-3aba-48fa-bd84-818ba0a6dae7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.164873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.165716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.166007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.166310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.167014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.168922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.179101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:06.182842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:06.183888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:06.184882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 421/839] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:06.191054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.203763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025702e6-a442-4a59-bd53-e49af8163042 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.245269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.246426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.246921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.247394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.262338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.264611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:06.288249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:06.289215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:06.290120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:06.290120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:06.290120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:06.290120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:06.294393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 419/840] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:06.295682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.317185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd61e9e-0d6b-4d95-9d82-932025004188 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.355385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.356218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.356613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.356928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.357753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:06.358137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.359644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.365282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 422/841] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:06.370338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.398507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.430286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a75a8-a375-4a5e-865e-d3cbfce9d79c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.478625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.479292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.479580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.479888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.481800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322f77e-f468-441b-8230-f7c09bdd04d5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.484873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:06.485430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.486969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.490240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.505358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 420/842] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:06.512008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.522347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.523147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.523528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.523929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.524777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:06.525344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.528127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.540256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 423/843] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:06.640474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f29d7-84aa-478a-9866-fd53db4fee22 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.677945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.678761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.679048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.679333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.687253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.688730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:06.704347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:06.705355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:06.706323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 421/844] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:06.713429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.811874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.826204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8be97-0542-45a1-a39a-266472c70d43 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:06.861029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:06.861625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:06.861946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:06.862224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:06.863113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:06.863428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:06.864894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:06.884059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 424/845] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:06.890067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:06.950816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:06.997239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9af38-e787-4190-bf25-1176e8b1879c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:07.033565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:07.034227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.034514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.034795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.103862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:07.105468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:07.160817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:07.207109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 422/846] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:07.213118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:07.322809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696092-cd3e-47f3-8cdb-648b5169e0ca None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:07.358902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:07.360067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.360644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.361128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.372512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:07.374206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:07.381378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:07.392968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:07.393865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:07.394769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:07.394769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:07.394769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:07.394769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:07.398954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 425/847] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:07.400326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:07.499889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e8460-feb4-4128-b00c-bf1a79cecd19 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:07.534299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:07.534966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.535254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.535538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.536376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:07.536693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:07.538645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:07.554262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 423/848] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:07.556346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:07.676374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a561cd-92d1-4b75-9898-1f1ff5650816 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:07.713053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:07.714127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.714565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.715023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.722558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:07.724245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3f54d603-ea22-4659-9d72-fd4b10b67801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:07.739977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:07.741158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:07.742296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:07.748112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 426/849] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:07.751082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:07.762876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81fc5-7b4c-48e3-9585-8fe80718d471 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.763391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81fc5-7b4c-48e3-9585-8fe80718d471 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.763824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb81fc5-7b4c-48e3-9585-8fe80718d471 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.765645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 427/850] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:07.770952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.771247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.772122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.776977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:07.794720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:07.796192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:07.869198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:07.873590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5cdcf-5055-45e1-bafc-eabb117bde85 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:07.892211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 428/851] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:07.912472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:07.917625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:07.918353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:07.918649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:07.918931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:07.919733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:07.920081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:07.921575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:07.940035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 424/852] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:07.947128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.030685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd34c65-3abb-4cdd-91a4-34c387c4c493 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.044871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.072718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6526f-f921-42f7-8ac4-216b6c5d5fce None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.078048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.079013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.079368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.079756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.080542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.081989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:08.095352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:08.096376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:08.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:08.102019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 429/853] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:08.102986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.121364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.122567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.123066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.123851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.124927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=6f5ec849ef0e431d8ad7e84c94fac8c6) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:08.125433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.127599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf36ff-8c35-439b-9e82-124db3c6d01d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.144192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 425/854] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:07 2022] GET /identity/v3/role_assignments?user.id=6f5ec849ef0e431d8ad7e84c94fac8c6&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:08.173147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.215494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e43df-1159-4b29-a470-c3a004cf62cd None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.216586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e43df-1159-4b29-a470-c3a004cf62cd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.217091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e43df-1159-4b29-a470-c3a004cf62cd None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.219979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 426/855] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:08.224956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.225539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.226205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.232807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb76e7-6519-47bf-9a64-07a121b146c0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.251372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:08.253420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:08.273293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.273977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.274266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.274548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.275283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:08.275601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.277440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.282765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 430/856] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:08.288481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.355683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 427/857] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:08.380020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.424280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b16d-7322-4dff-987f-c50b54164d4e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.447524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.469530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.475751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.477115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.477625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.478760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.479692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:08.480240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.482507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.490869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 431/858] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:08.498941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f906e9-d86d-4b03-a625-b202a202e35e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.539630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.540406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.540687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.541025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.554240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c3291319-9386-4257-a089-cfde5a6fc791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:08.562495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:08.563526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 08:58:08.564438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:08.568976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 428/859] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:08.571231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.688684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762ce1-6bf2-4459-9ef2-72dcd2dbb628 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.722897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850bb4-8fab-43b2-b9be-8858755227a9 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.723251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850bb4-8fab-43b2-b9be-8858755227a9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.723474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36850bb4-8fab-43b2-b9be-8858755227a9 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.725676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 429/860] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:08.727475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.728414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.728980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.729465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.730438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.730650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:08.730753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.731007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.731467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.733066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.743482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 432/861] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:08.748805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.749601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:08.751101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:08.797432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.848041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 430/862] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:08.872804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.877157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed921a-c209-49d9-b3e4-5f0ccd615996 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:08.919687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:08.920794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:08.921094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:08.921380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:08.935885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:08.937912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:08.941744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:08.962037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:08.963017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:08.963927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:08.963927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:08.963927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:08.963927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:08.967983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 433/863] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:08.968899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:08.996046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa9f74-171f-43c3-b8df-c00a71b5fbb8 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:09.034283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:09.035373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:09.036076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:09.036554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:09.038099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:09.039843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:09.057623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 431/864] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:08 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:58:09.077915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:09.090533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b681092-2ffa-47c8-8dd5-03bb99390d39 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:09.136345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:09.137404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:09.137968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:09.138462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:09.139468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:09.140005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:09.141616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:09.155815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 434/865] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:09.161003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:09.273792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d216-97df-4bd9-9b5a-286038143f7d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:09.295594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:09.311453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:09.312642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:09.313133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:09.313837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:09.322772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:09.324543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:09.340735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:09.341746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:09.342692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:09.345439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 432/866] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:58:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:09.351218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:09.454790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2db02-865e-4c43-90b9-85249a6e5aeb None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:09.489381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:09.490467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:09.490974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:09.491488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:09.492574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:09.493085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:09.494734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:09.513749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 435/867] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:58:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:09.519834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:09.630542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578ceae-c079-4738-94c0-3be333b9b82c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:09.671680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:09.672397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:09.672685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:09.672963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:09.726754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:09.746873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:09.748371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:09.851604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 433/868] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:09 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:09.857287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:09.869550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:09.969815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe810d4-33a8-4cef-bf7a-8d8ed1a44e52 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.008121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.009399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.009903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.010387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.021408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.023116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:10.041231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:10.042130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:10.043036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:10.043036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:10.043036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:10.043036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:10.045225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 436/869] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:10.050888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.139076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.158319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15688c0-df18-4ba6-b444-46be0af63506 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.200042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.200723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.201012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.201293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.202036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:10.202356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.203733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d8b-addb-4ada-a3ff-390a9a61153d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.216081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 434/870] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:10.221589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.290742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.339748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cd0c5-0ec1-4856-8650-5ef8423f1202 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.353877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d636-9b41-411a-8577-72817f0c3fef None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.354480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d636-9b41-411a-8577-72817f0c3fef None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.354988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13d636-9b41-411a-8577-72817f0c3fef None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.357259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 435/871] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:10.362547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.362847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.363133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.380031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.380436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:10.380881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.381167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.381446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.381688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:10.388394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.389943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:10.404561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:10.405458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:10.406358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:10.406801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 437/872] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:10.413629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.460209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 436/873] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:10.476250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.546753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f154-b13a-4c78-8ef3-217ae0523ccd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.551024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.575224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.592078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ba84a-194b-4439-84dd-9153ef48df60 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.602758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.603640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.604068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.604449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.605478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:10.605773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.607337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eeb2c4-3151-4d4e-ac9b-eae977f9aa16 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.620903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 438/874] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:10.622158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292106-9816-4fdf-91e3-de2aff3c5c43 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.622444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292106-9816-4fdf-91e3-de2aff3c5c43 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.622721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292106-9816-4fdf-91e3-de2aff3c5c43 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.624374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 439/875] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:10.628715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11292106-9816-4fdf-91e3-de2aff3c5c43 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.635928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.636783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.637065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.637340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.637999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.639354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-926d530c-1b5f-44d3-a448-9b89a7a170a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:10.652467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:10.653574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:10.654599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:10.656727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 437/876] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:10.658049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.658470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.658901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.676264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:10.677459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:10.746217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11292106-9816-4fdf-91e3-de2aff3c5c43 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.747381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 438/877] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:10.748242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.788584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.789591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.790087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.790589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.791536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=baa89e3c59b641fe89fcc36f75ee396c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:10.791864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.793318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.812326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 440/878] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/role_assignments?user.id=baa89e3c59b641fe89fcc36f75ee396c&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:10.813149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.814167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.871126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:10.877677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11893c5-26a0-4c21-bf59-64e4705ad07d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.918897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.919649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.919781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.920114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:10.920862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:10.921246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:10.922578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:10.929238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 439/879] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:10.934325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:10.947515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36506d3b-a6bd-4e28-b051-828b55749fbf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:10.996780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:10.998339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:10.999218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:10.999993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.000941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:11.003070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02458b62-7627-4530-93ff-a941c65cdf2c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:11.024599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 441/880] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:10 2022] POST /identity/v3/services => generated 269 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:11.074099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28033-304f-4d6f-8163-4795599bdd98 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:11.104963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:11.121677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:11.122346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.122625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.122903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.123623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:11.123937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:11.125356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35078-f47e-410f-81f3-1277d7b17fb2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:11.131115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 440/881] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:11.296866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fc49-59a0-4198-b1d2-1a95041ac190 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.297159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fc49-59a0-4198-b1d2-1a95041ac190 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.297445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08fc49-59a0-4198-b1d2-1a95041ac190 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.299119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 442/882] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:11.304607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.305064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.305180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.322918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:11.324156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:11.400145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 441/883] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:11.417859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08fc49-59a0-4198-b1d2-1a95041ac190 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:11.526122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08fc49-59a0-4198-b1d2-1a95041ac190 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:11.528520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:11.563074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:11.564132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.564566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.565011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.565816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:11.567588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:11.579848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:11.581082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:11.582109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:11.590540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 443/884] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:11.599453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:11.704217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c38b5-15e3-421b-a5df-c769470dd421 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:11.723509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:11.741465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:11.742146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.742435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.742714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.743432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:11.743745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:11.745151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:11.754898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 442/885] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:11.757175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:11.858507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa6656-a548-4c8a-ac2c-e0fd065e1f4a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:11.896588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:11.897605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:11.898096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:11.898575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:11.899509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:11.900060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:11.901622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:11.907126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 444/886] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:11.913592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:12.023260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e71f-fcd4-40a7-9d4b-401069492f83 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:12.057660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:12.058325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:12.058613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:12.058894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:12.059687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] RBAC: Adding query filter params (interface=public, service_id=a1483bdcb76e446ba268b8bce91984d4, region_id=RegionOne) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:12.060030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:12.061503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47de4e-a4e1-4f9b-a984-c26b122ac724 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:12.067882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 443/887] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:11 2022] GET /identity/v3/endpoints?service_id=a1483bdcb76e446ba268b8bce91984d4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:12.073520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:12.107813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:12.179336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dfa80-f9b5-4be4-8296-2aba710b95ab None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:12.214091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:12.214803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:12.215114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:12.215418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:12.216135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:12.217508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c6d5b-c9b3-43c7-a41b-b9ea08cc5d6c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:12.230091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 445/888] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:12 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 08:58:13.021964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f8416-b121-47c7-9768-2794bb3f58b9 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.022851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f8416-b121-47c7-9768-2794bb3f58b9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.023282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f8416-b121-47c7-9768-2794bb3f58b9 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.025068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 444/889] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:13.030529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc756-f6bc-405f-af12-7dad8eb2a1bf None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.031081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc756-f6bc-405f-af12-7dad8eb2a1bf None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.031579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbc756-f6bc-405f-af12-7dad8eb2a1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.049163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-16fbc756-f6bc-405f-af12-7dad8eb2a1bf None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:13.050632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-16fbc756-f6bc-405f-af12-7dad8eb2a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:13.118863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 446/890] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:13.143357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f8416-b121-47c7-9768-2794bb3f58b9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.192851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.225620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e5a-e548-4d73-9814-454833f8a1d7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.226255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e5a-e548-4d73-9814-454833f8a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.226757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894e5a-e548-4d73-9814-454833f8a1d7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.228613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 447/891] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:13.233766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964e12-1c1e-4811-bf0a-6b8cacf46c14 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.234316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964e12-1c1e-4811-bf0a-6b8cacf46c14 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.234794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964e12-1c1e-4811-bf0a-6b8cacf46c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.251371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-56964e12-1c1e-4811-bf0a-6b8cacf46c14 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:13.252973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-56964e12-1c1e-4811-bf0a-6b8cacf46c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:13.254434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f8416-b121-47c7-9768-2794bb3f58b9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.293818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.294562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.294847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.295132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.297218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.309401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-9dc64302-7a7c-421e-835b-12fb184611c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:13.317987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:13.319782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:13.320835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 445/892] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:13.323754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7261a9-815f-4480-9a26-29ab93b92e7f None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.324084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7261a9-815f-4480-9a26-29ab93b92e7f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.324370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7261a9-815f-4480-9a26-29ab93b92e7f None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.327109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 446/893] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:13.328667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7261a9-815f-4480-9a26-29ab93b92e7f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.333637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 448/894] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:13.335644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.335943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.336252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.353814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:13.355114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:13.427167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 449/895] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:13.428545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.450554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7261a9-815f-4480-9a26-29ab93b92e7f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.460061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.488090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.488759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.489043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.489319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.490596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:13.490905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:13.492289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:13.500599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 447/896] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:13.501177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.538895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.556358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e227d3-e6eb-4a50-9a85-4e2024137bfb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.596312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.600450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.600743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.601022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.601696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:13.603064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:13.607672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af67a0-b781-4183-8709-164c062eda17 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:13.617002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:13.618293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:13.619138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 450/897] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:13.620009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.649544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.650301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.650586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.650879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.651594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:13.652983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:13.667845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 448/898] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:13 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:13.673427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.717446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.744000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e132aa-b0f9-4600-93bc-c7faf3bb6aaf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.793691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.794362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.794714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.795077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.809824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:13.811309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:13.820507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.825908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae000-12da-461a-84b1-066a1ca3abb9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:13.837462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:13.838375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:13.839269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:13.839269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:13.839269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:13.839269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:13.839269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 451/899] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:13.845371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.868798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:13.869466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:13.869750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:13.870032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:13.870744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:13.871055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:13.873234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:13.882343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 449/900] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:13.883391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:13.989384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:13.991368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44b906-33cd-48c8-9ad9-c894713a81a5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.002785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecec7f-db71-47c5-9a31-6b5204201928 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.037399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.039069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.039648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.040159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.041129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:14.041785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.042970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.043707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.044090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.044300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.044443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.045284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:14.045654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.047179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.058556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 450/901] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:14.059069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.070236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 452/902] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:14.071083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.131336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.175303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c74ea-4fe2-412c-a451-1c65c9765bb8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.190144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469434-975d-4940-8c50-6fc0e47d4934 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.216092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.217768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.218483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.218940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.231332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.231937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.232805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.233177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.233521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.234393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] RBAC: Adding query filter params (interface=public, service_id=9ed009e3673e4ba28a2d0111e6ebe0a0, region_id=RegionOne) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:14.234777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.234951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.236246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.247022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 451/903] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/endpoints?service_id=9ed009e3673e4ba28a2d0111e6ebe0a0&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:14.248089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:14.259066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:14.260096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:14.261043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:14.263289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 453/904] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:14.268826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.283043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.376287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32997ce1-47b7-444e-9ea7-19f1bc2c2e7e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.377354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674aca5-d8bf-457f-8470-5b1acce0da25 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.394379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.413130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.413804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.414090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.414368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.414655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.415214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:14.415325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.415528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.415624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.415840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.416558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.417007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.417906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950aeb9-31d1-4058-945e-fcb397758af4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.432164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 452/905] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 08:58:14.432164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d271b-1126-41d4-9f23-091e6445df82 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.432164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d271b-1126-41d4-9f23-091e6445df82 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.432164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d271b-1126-41d4-9f23-091e6445df82 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.432164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 453/906] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:14.433168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.433465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.433750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.445771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 454/907] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:14.451899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.453470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:14.454684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:14.544546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 454/908] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:14.569611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.586588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.596223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f0bc1-4360-4d62-9234-b2fbf94ade71 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.651398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.652334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.652784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.653196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.705048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.710284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d304-6376-4925-9399-8009f32b5098 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.735287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.737231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.751117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.752169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.752601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.753025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.753834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.755362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:14.767859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:14.769046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 08:58:14.769908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:14.772460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 455/909] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:14.779138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.847853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 455/910] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:14.861293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.877188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.905282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1d80f-ad67-4627-b282-08b2c7f1563c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:14.951662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:14.952547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:14.953829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:14.954298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:14.955026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:14.956034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:14.956820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:14.958831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:14.965810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 456/911] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:14.970543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:14.987003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037341-aad4-4d0b-9341-b0d70b6bfc21 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.025210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.026346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.026847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.027350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.039472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.041341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:15.060382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:15.061389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:15.062281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:15.062281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:15.062281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:15.062281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:15.064609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 456/912] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:15.070011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:15.087287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b72fd-9661-406c-aaf1-b2842632b310 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.129109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.129810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.130101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.130384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.131124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:15.131442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.132921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.138340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 457/913] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 23 08:58:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:15.144537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:15.154823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:15.182061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f5ea-9aa1-4cc6-86fb-d0078029980d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.210456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:15.220656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.221667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.222154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.222629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.223657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:15.224341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.226429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.244152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 457/914] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:15.245408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:15.256989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7da6-d051-4a50-8d87-038b0fc793e4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.294688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.295435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.295729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.296149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.296919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.298445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.327978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 458/915] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:58:15.367850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac8e3a-449e-4e51-8db1-5f2f92562c87 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.414397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.415312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.415609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.415897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.423821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.425331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:15.441729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:15.442681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:15.444177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 458/916] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:15.451217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:15.520298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:15.562176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39d2ab-3467-496a-8af7-002676234060 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.601886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.602562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.602854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.603135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.603943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:15.604287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.605727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3dc1-946e-4580-b331-2076f88a5adb None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.619697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 459/917] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:15.625480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:15.674977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:15.737198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101255a1-e02a-4e1f-8810-353a518263d4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:15.773103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:15.773759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.774042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.774320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.775149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] RBAC: Adding query filter params (role.id=24e74e95ec614d54b1a1083b6df0be30, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=baa89e3c59b641fe89fcc36f75ee396c) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:15.775462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:15.776914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd0cd-1b78-4b46-93a9-733c2a14fbd0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:15.782807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 459/918] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:15 2022] GET /identity/v3/role_assignments?user.id=baa89e3c59b641fe89fcc36f75ee396c&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=24e74e95ec614d54b1a1083b6df0be30 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:15.819827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdc6d-071e-4931-b495-a85eba94ae90 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.820495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdc6d-071e-4931-b495-a85eba94ae90 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.820982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fdc6d-071e-4931-b495-a85eba94ae90 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.822926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 460/919] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:15.828843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:15.829437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:15.829918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:15.848373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:15.850007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:15.928656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 460/920] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:15.952313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fdc6d-071e-4931-b495-a85eba94ae90 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.055460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fdc6d-071e-4931-b495-a85eba94ae90 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.089971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:16.092844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:16.093907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.094395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.094891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.095907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:16.097554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:16.110454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:16.111512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:16.112415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:16.115419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 461/921] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:16.125091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.168389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:16.230584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785c425-dc5b-464c-abb1-6c1d7d2e0133 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.265762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:16.266435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.266742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.266994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.267706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:16.268041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:16.269408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:16.275325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 461/922] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:16.280942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.392349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a85a54-154a-4eca-8662-3ce595ebf1b6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.427108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:16.427854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.428185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.428471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.429194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:16.429514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:16.431066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:16.436652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 462/923] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:16.444738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.546144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffbc15-6f98-4481-8942-3583b0e82c35 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.547855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:16.587369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:16.587369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.587746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.587746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.588551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] RBAC: Adding query filter params (interface=public, service_id=e70990931c09431e9fd96d43137b8370, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:16.588873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:16.590318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f2895-a1ab-497c-9c21-378ff09f0fc3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:16.599131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 462/924] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:16 2022] GET /identity/v3/endpoints?service_id=e70990931c09431e9fd96d43137b8370&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:16.604574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.657837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:16.710304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96e24b-5a72-47fe-a7de-40880c59f2e7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.721275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb77d0-b94b-4a94-bb2f-6e6c2fc6e01c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.721885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb77d0-b94b-4a94-bb2f-6e6c2fc6e01c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.722176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb77d0-b94b-4a94-bb2f-6e6c2fc6e01c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.724294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 463/925] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:16.730291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.730586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.730860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.748414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:16.748824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:16.749498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:16.749675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:16.749786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:16.750058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:16.750752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:16.752379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:16.759619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 463/926] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:16 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 08:58:16.832121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 464/927] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:16.855108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:16.970150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3366-b002-47fa-b9e7-6c4b6d845d13 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:16.985478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:17.008590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:17.009405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.009690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.009967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.010626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:17.012013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:17.024422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:17.025387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.026235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 464/928] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 23 08:58:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:17.033626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:17.134197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:17.140171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d78d9-817e-419b-ac38-e88707c1cdb5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:17.184582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:17.185252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.185540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.185827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.186545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:17.186863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:17.188320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:17.193810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 465/929] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:17.201137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:17.309104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33542c42-e0be-4da3-9604-e8263bce195b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:17.345023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:17.346086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.346579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.347062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.347997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:17.348588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:17.350235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26920b-aaeb-421c-b7ee-798c62215ea0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:17.360082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 465/930] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:17.365546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:17.470358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d535539-7efb-4190-b51c-24f00920f4d1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:17.507823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:17.508515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.508803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.509087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.509851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:17.511226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff729c6-debb-4e53-8c0f-3ded33d895da None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:17.531736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 466/931] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:17.577567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c206-9742-4ab8-ab1f-f7f517ebc6f4 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.577890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c206-9742-4ab8-ab1f-f7f517ebc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.578072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c206-9742-4ab8-ab1f-f7f517ebc6f4 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.579750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 466/932] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:17.587314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e1c1-0ac6-47f4-ac20-6ca27fb4a26a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.587314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e1c1-0ac6-47f4-ac20-6ca27fb4a26a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.587314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e1c1-0ac6-47f4-ac20-6ca27fb4a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.604123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e335e1c1-0ac6-47f4-ac20-6ca27fb4a26a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:17.607529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e335e1c1-0ac6-47f4-ac20-6ca27fb4a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:17.620822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:17.696669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 467/933] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:17.720112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266c206-9742-4ab8-ab1f-f7f517ebc6f4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:17.767646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:17.828382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266c206-9742-4ab8-ab1f-f7f517ebc6f4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:17.863980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:17.864653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.865508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.865798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.866517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:17.867969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:17.869320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING keystone.server.flask.common [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 08:58:17.883380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9ebd-0a57-42b3-a23d-ce311652b1da None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.883682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9ebd-0a57-42b3-a23d-ce311652b1da None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.883944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9ebd-0a57-42b3-a23d-ce311652b1da None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.885342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 468/934] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:17.887672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.sql.core [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 08:58:17.887672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 08:58:17.887672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [parameters: {'id': 'b891cc67f5e64ad19d870bbaff6d3511', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 08:58:17.887672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80402) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 08:58:17.890823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:17.891107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:17.891380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b891cc67f5e64ad19d870bbaff6d3511.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b891cc67f5e64ad19d870bbaff6d3511. Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:58:17.895488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 08:58:17.896386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application yield resource Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise self.value Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application session.commit() Jun 23 08:58:17.897396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.flush() Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application compat.raise_( Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 08:58:17.898293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 08:58:17.901132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:58:17.903002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [parameters: {'id': 'b891cc67f5e64ad19d870bbaff6d3511', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.904222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:17.905260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b891cc67f5e64ad19d870bbaff6d3511. Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 467/935] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jun 23 08:58:17 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:17.906430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:17.917229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:17.918768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:18.010166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 469/936] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:18.024807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:18.027277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cf4a-6d47-4c70-b0c4-88e930e0dd9c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.033401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.076933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.076933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.076933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.076933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.083028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.085172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:18.098919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:18.100516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:18.101496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:18.105499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 468/937] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:18.106495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.122140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:18.152891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2202a1-2042-42d4-830d-545949efea4e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.191183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.192456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.192836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.193244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.206654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:18.218039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:18.219164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:18.220157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 470/938] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:18.226507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.239120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30ebdd-31f3-4a8e-a7c5-11f110aa3a63 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.287469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.288179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.288469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.288770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.289850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:18.290170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.292245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.328013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 469/939] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:18.359855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17decb-958f-4830-a52c-eed7aa280dbd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.395222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:18.399271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.401337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.401337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.401337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.401586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:18.401656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.403050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.418868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.419757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 471/940] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:18.440379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:18.535166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f445-fd23-4bdd-9c09-059951e98671 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.572707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.573876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.574369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.574871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.589089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.591603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:18.613339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:18.614297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:18.615270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:18.615270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:18.615270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:18.615270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:18.617547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 470/941] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:18.623867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.730225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18355ef5-b5b7-4cec-937c-e0b3198ac9ba None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.767353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.768327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.768782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.769227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.770128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:18.770597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.772188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74388048-bef4-4363-a476-cbf5925aa1d9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.784476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 472/942] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:18.790282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.865961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:18.899505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c304f-dc16-463d-b22b-ececf7387f39 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:18.936382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:18.937194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.937475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.937749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.946540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:18.947990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:18.957015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1076d-87b4-42e3-bb75-acade5be12c8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.957590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1076d-87b4-42e3-bb75-acade5be12c8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.958085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1076d-87b4-42e3-bb75-acade5be12c8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.959941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 473/943] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:18.963269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:18.964263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:18.965223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 471/944] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:18.971606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:18.972390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:18.972899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:18.973378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:18.991485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:18.993025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:19.042705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.062049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 474/945] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:19.090155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.092374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c64a9e-6143-4f82-8ae2-85d560bd649a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.128925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.137505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.139026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.139533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.140037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.141475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:19.142322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.144312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.172489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 472/946] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:58:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:19.174282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.218305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a30b-7b65-47dd-b9da-80ae57be384f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.266076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.266887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.267170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.267442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.268209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.272274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:19.290526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:19.291748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:19.292668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:19.296110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 475/947] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:19.298328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.326603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe0f3-9c0d-4f06-a5fb-2763824fd537 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.369149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.373480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.374310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.375000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.375315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.389901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.391569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:19.415285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:19.416506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:19.417420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:19.417420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:19.417420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:19.417420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:19.420102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 473/948] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:19.423312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.442415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f67fc-d248-4ff2-9e57-6cc7a18b34b8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.478981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.489044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.489718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.490565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.490854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.491585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:19.492065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.493308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.503164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 476/949] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:19.505374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.561650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b7b2-4ff3-4dda-b115-bb045090cc08 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.613605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.614702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.615031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.615318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.616133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:19.616455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.618291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.636040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 474/950] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:19.639617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.651305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8a4a2-26fd-485a-8e0b-a449676858aa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.668242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.691707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.692404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.692694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.692996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.693795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:19.694109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.695596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca605cf-7b58-408c-b698-79591e61e224 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.705115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 477/951] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:19.705115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf80a1-a875-4a60-8454-e12638d7222d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.705115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf80a1-a875-4a60-8454-e12638d7222d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.705115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf80a1-a875-4a60-8454-e12638d7222d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.705115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 478/952] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:19.706855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf80a1-a875-4a60-8454-e12638d7222d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.750330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.753464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a53eaa-baf8-4732-b097-d2b1f10613c9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.787932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.788773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.789067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.789352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.796372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.797808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-eda67ed7-3e52-4686-b41e-a40a1722b8e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:19.812008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:19.812919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:19.813978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:19.818313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 475/953] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:19.819662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.819774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf80a1-a875-4a60-8454-e12638d7222d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:19.819986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.820263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.837929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:19.839586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:19.856473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:19.857383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:19.857675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:19.857958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:19.859092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:19.860503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:19.883359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 479/954] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:58:19.893113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:19.930487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 476/955] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:19.938130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:19.956779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.018285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b859-00d0-4aa2-a293-d38a6880f67f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.057855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.059352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.059740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.060171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.061136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:20.061544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.063034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:20.063156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.078485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 480/956] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:20.082758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd901f80-efb8-4d40-aaa5-e03e81d85a32 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.086881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.126283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.127102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.127389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.127669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.128392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.129760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:20.142409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:20.143859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.145022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 477/957] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:20.151869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.200328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:20.210207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98510a1c-cf20-43d1-b952-6a867e97e3aa None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.245874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.246827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.247471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.247471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/baa89e3c59b641fe89fcc36f75ee396c/roles/24e74e95ec614d54b1a1083b6df0be30` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.249874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=baa89e3c59b641fe89fcc36f75ee396c, role_id=24e74e95ec614d54b1a1083b6df0be30)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.251390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.275989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34d770-3698-4ddf-af2c-0cf29e677cf8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.276223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 481/958] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:20 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/baa89e3c59b641fe89fcc36f75ee396c/roles/24e74e95ec614d54b1a1083b6df0be30 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:58:20.319117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.319869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.320190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.320506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.321599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:20.321971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.323379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44787-6e75-4695-8ecd-7d90965b1c1a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.329680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 478/959] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:20.336140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.452259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a7e80-42e4-4903-9964-4941c7af94f4 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.492279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.492986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.493240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.493523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.494240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:20.494551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.496232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ecff5-7454-43ee-a45c-6cc7fa7950ee None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.501325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 482/960] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:20.515894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e945-121d-4bc7-9f72-7242c0699aa9 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.516252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e945-121d-4bc7-9f72-7242c0699aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.516506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8e945-121d-4bc7-9f72-7242c0699aa9 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.519426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 479/961] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:20.524764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.525070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.525339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.544472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:20.545703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:20.561248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:20.637591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 483/962] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:20.663094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8e945-121d-4bc7-9f72-7242c0699aa9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.681067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:20.778267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8e945-121d-4bc7-9f72-7242c0699aa9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:20.814834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:20.815518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:20.815809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:20.816121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:20.817114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:20.819069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:20.833387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.sql.core [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 08:58:20.833387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 08:58:20.833387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [parameters: {'user_id': '8a7b1212a5b14a2c846553fac0b53386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 08:58:20.833387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80402) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:58:20.842310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:58:20.843217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application yield resource Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application next(self.gen) Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise self.value Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application session.commit() Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 08:58:20.844236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.session.flush() Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application compat.raise_( Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 08:58:20.845186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 08:58:20.846116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application conn.query(q) Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application result.read() Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 08:58:20.846978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [parameters: {'user_id': '8a7b1212a5b14a2c846553fac0b53386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:20.849628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 08:58:20.851565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 08:58:20.853797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:20.856514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 480/963] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 23 08:58:20 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:20.864184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:20.981285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ac0c4-d102-457c-bc28-b6c2841f63fc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:21.017031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:21.017828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:21.018110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:21.018385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:21.026148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:21.027588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1303adfc-9393-4180-bf95-feb85242d5fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:21.042514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:21.044697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:21.046972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 484/964] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:21.050578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:21.139894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:21.163211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395920c-3740-459c-828a-0d85bfd3cc3c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:21.200936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:21.202099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:21.202593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:21.203076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:21.204135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:21.204675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:21.206513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb458c-ed99-4f54-9bfb-8ab2a60d4799 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:21.252101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 481/965] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 23 08:58:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:21.980313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd30ef-1bf6-48e2-a989-8a5b78ee7cf7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:21.980813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd30ef-1bf6-48e2-a989-8a5b78ee7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:21.980813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd30ef-1bf6-48e2-a989-8a5b78ee7cf7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:21.982556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 485/966] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:21.988162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:21.988567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:21.988751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.006063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:22.007567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:22.076677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 482/967] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:22.099840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd30ef-1bf6-48e2-a989-8a5b78ee7cf7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.109134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.203376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd30ef-1bf6-48e2-a989-8a5b78ee7cf7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.237209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.237926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.238217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.238490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.239142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:22.240558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:22.252522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:22.253520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:22.254441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:22.259099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 486/968] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:22.260086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.322634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.373668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d8d1-42f3-439a-aa1b-80b035e84665 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.408293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.408962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.409244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.409523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.410232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:22.410544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:22.411985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c75fc6-5c3b-4157-998c-895ba66a2f6c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:22.417095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 483/969] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:22.422533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.468159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7168-68a5-4b6c-806f-cbcaea2361b6 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.468491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7168-68a5-4b6c-806f-cbcaea2361b6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.468740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7168-68a5-4b6c-806f-cbcaea2361b6 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.470478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 484/970] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:22.476166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.476464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.476747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.493774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:22.494888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:22.499476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.534779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9f888-8327-4c45-ac01-c17a0c0d4c05 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.570663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.571329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.571626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.571907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.572648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:22.572965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:22.574328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:22.576079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 485/971] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:22.579453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 487/972] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:22.585194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.594023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.650428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.697707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4344-5d96-43ba-bf17-30409fcc8916 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.699855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3250eee-d223-4cd4-9233-8260bef5d239 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.731021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.731915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.732242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.732519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.733261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.733917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.734212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.734496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.734630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.735300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] RBAC: Adding query filter params (interface=admin, service_id=e70990931c09431e9fd96d43137b8370, region_id=RegionOne) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:22.735620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:22.737973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf71c94-1ea4-43fc-af2c-e2b0ce5510c5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:22.743347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 486/973] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/endpoints?service_id=e70990931c09431e9fd96d43137b8370&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:22.743716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:22.744481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabde71-a052-4fa1-9b14-e7aa8ebcb284 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.744719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabde71-a052-4fa1-9b14-e7aa8ebcb284 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.744998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabde71-a052-4fa1-9b14-e7aa8ebcb284 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.746377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 487/974] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:22.748480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabde71-a052-4fa1-9b14-e7aa8ebcb284 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-bfebdcb1-6695-470f-9226-5742e52cf14e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:22.752300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:22.753410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:22.754286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 488/975] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:22.755010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.755010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.755263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.773905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:22.775118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:22.840221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 489/976] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:22.841031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.851587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabde71-a052-4fa1-9b14-e7aa8ebcb284 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.875047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.887730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.888566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.888927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:22.889217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:22.889908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:22.891270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:22.897785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 488/977] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 08:58:22.898536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:22.959900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718feb-bd9c-44b8-aca4-6a12b76fd0b5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:22.986782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:22.998844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:22.999620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:22.999985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.000338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.001195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:23.001567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.003032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.013712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 490/978] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:23.017776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6afda3-c8f5-4e46-9fa9-41bdc32f5e1b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.019203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:23.065052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a83779-5359-410b-97e4-40c966977811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.065844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a83779-5359-410b-97e4-40c966977811 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.066127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a83779-5359-410b-97e4-40c966977811 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.066667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a83779-5359-410b-97e4-40c966977811 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.067409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a83779-5359-410b-97e4-40c966977811 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.069346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a83779-5359-410b-97e4-40c966977811 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.084418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 489/979] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:22 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:23.135697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27fe55-6d40-4648-b2c8-54d4b165eab3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.180982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.182077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.182506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.182942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.196146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.198059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:23.218567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:23.219596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:23.220578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:23.220578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:23.220578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:23.220578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:23.221253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 491/980] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:23.226748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a83779-5359-410b-97e4-40c966977811 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:23.281424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:23.339974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a83779-5359-410b-97e4-40c966977811 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.378138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.378817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.379101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.379375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.380137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:23.380480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.381842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.396664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 490/981] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:23.402392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:23.438314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:23.510797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6376a-f320-454d-b0e0-2886a1509fd8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.546519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.547250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.547534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.547807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.555878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.557353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:23.573381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:23.574370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:23.575325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 492/982] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:58:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:23.583060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:23.698131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6e3a6-632b-493a-95bb-bf7d9b31de63 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.705895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:23.734439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.735110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.735391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.735668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.736535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:23.736850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.738261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:23.760756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 491/983] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 23 08:58:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:23.762373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:23.860216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:23.867981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d1d6-ddf9-4b51-8e30-d70964de167d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:23.903154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:23.904179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:23.904521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:23.904865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:23.971892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:23.973364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.090211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:24.103725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 493/984] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:23 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 08:58:24.105453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:24.232528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2ba10-605f-49c5-a4b5-7ee417a41cb4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:24.266422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:24.267536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:24.268057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:24.268533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:24.280063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:24.281755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:24.300322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:24.301272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:24.302235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:24.302235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:24.302235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:24.302235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:24.304522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 492/985] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:24.309724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:24.430472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06f0cd-fa1e-44a7-95c3-df52177a781b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:24.464919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:24.465815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:24.466116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:24.466394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:24.467311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:24.467620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:24.469004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.481442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 494/986] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:24.486898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:24.507468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:24.595012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684775b5-a323-4bf0-8516-a61b7fd0c9a4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:24.632661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:24.633451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:24.633730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:24.634001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:24.640801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:24.642222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:24.656668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:24.657584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:24.658517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:24.660027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 493/987] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:24.664034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:24.719472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:24.765329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a1314-8041-427d-bdd1-c3dce574249e None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:24.800225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:24.800887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:24.801171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:24.801446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:24.802274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:24.802589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:24.804031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffe8df-4ebc-412b-9f69-84361edaf860 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.816548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 495/988] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:24.822210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:24.899624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:24.924711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b554cf-e217-4cd8-a754-31aada375d2e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:24.958048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:24.959241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:24.959522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:24.959798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:24.960653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] RBAC: Adding query filter params (role.id=24e74e95ec614d54b1a1083b6df0be30, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=baa89e3c59b641fe89fcc36f75ee396c) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:24.960967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:24.962380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468a4c-b780-42e3-a9c1-5dbd07b6a8cf None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:24.968513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 494/989] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:24 2022] GET /identity/v3/role_assignments?user.id=baa89e3c59b641fe89fcc36f75ee396c&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=24e74e95ec614d54b1a1083b6df0be30 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:25.027304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe492f-5ea5-4e49-8693-3da278adf92b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.027600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe492f-5ea5-4e49-8693-3da278adf92b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.027778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe492f-5ea5-4e49-8693-3da278adf92b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.029406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 496/990] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:25.034936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75ca7-db5f-486c-9e4a-4741abb58020 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.035245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75ca7-db5f-486c-9e4a-4741abb58020 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.035517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75ca7-db5f-486c-9e4a-4741abb58020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.054042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-01c75ca7-db5f-486c-9e4a-4741abb58020 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:25.055268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-01c75ca7-db5f-486c-9e4a-4741abb58020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:25.131016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 495/991] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:25.155457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe492f-5ea5-4e49-8693-3da278adf92b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.264851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe492f-5ea5-4e49-8693-3da278adf92b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.279549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.288129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5584f-7779-4d3a-816d-a634ba7d4007 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.288501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5584f-7779-4d3a-816d-a634ba7d4007 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.288859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5584f-7779-4d3a-816d-a634ba7d4007 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.290462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 496/992] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:25.295520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.295821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.296138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.300760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.301851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.302996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.303292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.303980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.305371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.313110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:25.314389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:25.319058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:25.320128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 08:58:25.321028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:25.325292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 497/993] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:25.326138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.384157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.400342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 497/994] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:25.413555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.440954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd61846-b137-49f2-b2bd-02ffa8855fa6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.479672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.480371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.480663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.480944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.481659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:25.481973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.483348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.489389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 498/995] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:25.495827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.518693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727b40c-8c4f-4462-8fa5-9cdb0e71906d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.541343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.559856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.560702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.560988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.561272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.561946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.563321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:25.575844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:25.577065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:25.578068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 498/996] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:25.582825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.615443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f74d-9984-4584-a17c-e2db91d06d96 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.649817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.653755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.654909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.655204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.655487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.656394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:25.656710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.658087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.663140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 499/997] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:25.668961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.691762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d0ecc-ae30-4fe2-bfc9-18de56aeac95 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.730350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.731164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.731453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.731741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.732531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:25.732850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.734452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.740356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 499/998] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:25.745739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:25.777982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124eae-a2f7-4fe1-8641-eec911604da9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.784904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.813760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.814339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.814627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.814911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.815663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.817359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.834634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 500/999] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:58:25.853895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e64847-fc35-473e-bedf-977616bf0cb2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:25.885635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:25.901586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:25.902277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:25.902567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:25.902848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:25.903569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:25.903885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:25.905323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:25.916228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 500/1000] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:25.918051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:26.028795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c843a-aa2c-47f0-b2f5-4927d384f173 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:26.064248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:26.064837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:26.065129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:26.065413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:26.066210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] RBAC: Adding query filter params (interface=public, service_id=99abbc691b034c858df6f589845420a4, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:26.066787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:26.068201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dbf3-d13c-4475-8ae6-283a98bfdbac None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:26.073608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 501/1001] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:25 2022] GET /identity/v3/endpoints?service_id=99abbc691b034c858df6f589845420a4&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:26.079020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:26.184948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a873-02f0-4897-92e3-abea38975021 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:26.218489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:26.219158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:26.219447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:26.219730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:26.220455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:26.221820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4de93-1ba7-4f15-8d4c-a2355aeb27d6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:26.236057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 501/1002] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:26 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 08:58:27.026745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f003-e730-4b54-9edb-ae9a1c9648ff None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.027272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f003-e730-4b54-9edb-ae9a1c9648ff None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.027272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757f003-e730-4b54-9edb-ae9a1c9648ff None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.028834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 502/1003] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:27.033672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.033965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.034246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.050736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:27.051911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:27.100180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:27.121116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 502/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:27.143291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f003-e730-4b54-9edb-ae9a1c9648ff None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:27.173694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:27.247225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757f003-e730-4b54-9edb-ae9a1c9648ff None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:27.281224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:27.281985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.282273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.282547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.283197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:27.284665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:27.296389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:27.297463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:27.298335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:27.300038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 503/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 23 08:58:27 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:27.304029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:27.406668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a71e8d-76d6-41eb-a019-766be31db551 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:27.441079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:27.442259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.442720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.443219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.444148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:27.444648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:27.446175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acf1b4-5aee-4439-8d0c-cf49c76594a1 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:27.455561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 503/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:27.456814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:27.549578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:27.557532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810e3cc-03af-4a87-8e09-b2d8e36c8f7f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:27.594539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:27.595537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.596049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.596500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.597378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:27.597857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:27.599922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62eeed-bd28-4e22-8d9b-5e113cb84638 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:27.606405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 504/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:27.889074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78b57-02eb-4c43-a60a-4f28352c5832 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.889386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78b57-02eb-4c43-a60a-4f28352c5832 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.889552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78b57-02eb-4c43-a60a-4f28352c5832 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.891088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 504/1008] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:27.896721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:27.897019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:27.897302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:27.914451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:27.915644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:27.982944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 505/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:28.009858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78b57-02eb-4c43-a60a-4f28352c5832 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:28.062513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:28.118273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78b57-02eb-4c43-a60a-4f28352c5832 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:28.152841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:28.153556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.153842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.154116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.155289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:28.156752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd3e7e-a72a-4178-93ce-1208d4420464 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:28.158536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 505/1010] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:28.164100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:28.250419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:28.264271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3961e-7e77-4bc2-ac90-c5bcac11e90b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:28.271749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8845b-9bb0-4ad5-b923-5c9e6cfe02e8 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.272106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8845b-9bb0-4ad5-b923-5c9e6cfe02e8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.272369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8845b-9bb0-4ad5-b923-5c9e6cfe02e8 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.273901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 506/1011] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:28.278835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.279124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.279413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.296261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:28.297435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:28.299554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:28.300251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.300539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.300817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.301542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:28.302994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:28.334609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 506/1012] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:28 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:28.385681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 507/1013] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:28.409457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:28.517931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaebf4-094b-4762-b6c4-ccf298ac6f76 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:28.551819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:28.553169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.553448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.553723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.554377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:28.555745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:28.568353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:28.569465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:28.570827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 507/1014] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:28.577977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:28.631101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:28.691897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d2faf-893c-4283-a7d4-37e40adec6c1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:28.729395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:28.730068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.730355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.730634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.731348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:28.731689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:28.733278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:28.738285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 508/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:28.744044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:28.748909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:28.849834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d13d-1f49-4b2c-9a06-a531a571eb55 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:28.885447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:28.886468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:28.886963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:28.887447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:28.888469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:28.889007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:28.890594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97d3d2-0e27-43c5-b25c-6ddef8f6ad22 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:28.896836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 508/1016] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 23 08:58:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:28.901964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:29.003042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970a5ac-a91a-4b52-949f-b6c4f457c1c2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:29.012967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:29.040100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:29.040775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:29.041066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:29.041345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:29.042106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:29.043470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03b5e4-759d-415e-8c79-4b717031d32d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:29.068235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 509/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:29.648046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147e48-1d57-4f44-8dc2-252ed74bcddb None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:29.648586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147e48-1d57-4f44-8dc2-252ed74bcddb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:29.648586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147e48-1d57-4f44-8dc2-252ed74bcddb None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:29.649967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 509/1018] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:29.655232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8fcd-6077-4495-811c-60cb27ff236e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:29.655629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8fcd-6077-4495-811c-60cb27ff236e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:29.655823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8fcd-6077-4495-811c-60cb27ff236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:29.673122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fe8a8fcd-6077-4495-811c-60cb27ff236e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:29.674317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fe8a8fcd-6077-4495-811c-60cb27ff236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:29.754623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 510/1019] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:29 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:29.777024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147e48-1d57-4f44-8dc2-252ed74bcddb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:29.845237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:29.883017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147e48-1d57-4f44-8dc2-252ed74bcddb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:29.916505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:29.917173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:29.917466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:29.917751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:29.918490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:29.919855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4890cae-67fb-4bbf-9039-1decb28ad6c0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:29.943997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 510/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:29 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:30.428472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19f76-e895-424b-a8d2-1a1bfb45de5e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:30.428859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19f76-e895-424b-a8d2-1a1bfb45de5e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:30.429045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a19f76-e895-424b-a8d2-1a1bfb45de5e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:30.430667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 511/1021] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:30.435749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:30.436072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:30.436355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:30.453423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:30.454600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:30.527613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 511/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:30.551803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a19f76-e895-424b-a8d2-1a1bfb45de5e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:30.650609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:30.663795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a19f76-e895-424b-a8d2-1a1bfb45de5e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:30.698317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:30.699036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:30.699319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:30.699592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:30.700788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:30.702268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc9987-7af5-478a-8f76-a0337234ed75 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:30.704121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 512/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:30.709670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:30.763516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:30.810139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1cec9-a781-4ffb-bb52-8f5f9f019c09 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:30.843429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:30.844123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:30.844410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:30.844691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:30.845404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:30.846822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efb59-685f-41bf-9a10-580f75da42bc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:30.869171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 512/1024] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:58:30 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:31.190926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c358-8586-4f8b-881f-3f28e7bf998a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.191223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c358-8586-4f8b-881f-3f28e7bf998a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.191997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c358-8586-4f8b-881f-3f28e7bf998a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.194081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 513/1025] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:31.199218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.199518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.199804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.216880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:31.218082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:31.283118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 513/1026] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:31.306139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c358-8586-4f8b-881f-3f28e7bf998a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:31.409668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c358-8586-4f8b-881f-3f28e7bf998a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:31.444328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:31.445074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.445361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.445641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.455889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:31.464734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:31.465646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:31.466497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:31.468275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 514/1027] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:31.472285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:31.514434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:31.573437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41591147-de66-49d7-ab79-6218d82511c7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:31.623847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:31.625008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.625509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.626006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.627397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:31.627971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:31.631032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:31.649661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 514/1028] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:31.651215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:31.671786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:31.762108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171c561-2270-45ff-9c1c-3af3e7b80221 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:31.796497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:31.797628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.798092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.798561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.810019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:31.811639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:31.829665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:31.830576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:31.831471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:31.831471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:31.831471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:31.831471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:31.833298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 515/1029] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:31.838881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:31.939865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8bd45-09ee-44c2-ba52-9b47e5ed4a79 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:31.941670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:31.975084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:31.975743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:31.976066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:31.976344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:31.977069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:31.977380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:31.978743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765103-f4ac-4b14-9a8b-26f50ba8a974 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:31.996346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 515/1030] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:31.997984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.018749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a2db-190c-412b-94ae-27866dfb9260 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.019278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a2db-190c-412b-94ae-27866dfb9260 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.019562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249a2db-190c-412b-94ae-27866dfb9260 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.021272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 516/1031] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:32.026950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.027237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.027520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.045700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:32.046916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:32.081167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.117389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbec8fb-3fb0-4282-90bd-f1cfa1cb3ea2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.119940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 517/1032] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:32.142204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.150940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.151734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.152049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.152332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.159754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.161224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:32.175595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:32.176597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:32.183142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 516/1033] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:58:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:32.185821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.243926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.253626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea2bc-12b4-4a5f-b711-f004378c4f27 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.287785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.288117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c655f-13c4-4f0c-bf8c-9b41f9526a4d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.288522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.288804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.289074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.289722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.291086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:32.302513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:32.303536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:32.304594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 518/1034] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:32.309411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.319936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.329624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.330299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.330583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.330860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.331705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:32.332103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.334045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.353741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 517/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:32.359190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.418487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19bf6d-6e26-461e-9fe9-8d61a68a3fd3 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.456065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.456738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.457027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.457308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.458025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] RBAC: Adding query filter params (name=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:32.458850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.460248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.463453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9ae1-3080-485c-bf69-ce76a1b236c7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.465588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 519/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:32.470970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.493338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.500420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.501072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.501355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.501634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.560148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.573802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.575230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccacaf-c05d-4ddd-9e7c-3ad59b705c63 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.575416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.613077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.613856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.614217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.614608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.615327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:32.615644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.617049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.622541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 520/1037] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:32.628045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.688443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 518/1038] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 08:58:32.695583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.722588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.740825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b331cb-0adb-4039-b328-ea448c1c1b53 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.776002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.776655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.776943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.777241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.777992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] RBAC: Adding query filter params (interface=public, service_id=cf5dc775bd254ca090eb7d8c380fb9d1, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:32.778308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.779654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.785511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 521/1039] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/endpoints?service_id=cf5dc775bd254ca090eb7d8c380fb9d1&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:32.790725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.791942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:32.805365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef945d2-d97d-4da7-aa70-ffef560a60f2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.843864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.844620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.844909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.845188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.855576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.857050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:32.875066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:32.876044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:32.877087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:32.877087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:32.877087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:32.877087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:32.877087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 519/1040] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:32.882311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:32.901837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac2e03-d5e5-4601-91d2-94a053df1e77 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:32.945182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:32.946106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.946810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.947106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.948137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:32.950337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ec62-8023-451d-a5bd-adb2eb55c900 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:32.960128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 522/1041] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 08:58:32.976573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c16c-d254-4829-9676-0af72fbde0bb None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.976888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c16c-d254-4829-9676-0af72fbde0bb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.977147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c16c-d254-4829-9676-0af72fbde0bb None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.978715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 523/1042] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:32.985766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:32.986078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:32.986342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:32.994429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25730-7adb-4972-a7a7-15f1730e8230 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.005870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:33.007132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:33.016576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.033043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.033727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.034013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.034287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.035028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:33.035338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.036807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.046098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.051183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 520/1043] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:33.057467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.095765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 524/1044] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:33.120037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.168979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcccb4f-3ec9-4893-a615-46e0c01fc59b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.208016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.208973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.209262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.209539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.216582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.218032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.225406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c843bcf-6a11-45e4-8090-023a0c437493 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:33.234509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:33.235460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:33.236527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 521/1045] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:33.241962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.264590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.265499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.265784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.266061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.276259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:33.283842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:33.284870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:33.285753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 525/1046] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:33.290861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.294358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.310881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.356868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0b72a-fdc5-460d-aeb9-3c5f55dfedd4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.393191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.393854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.394137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.394415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.395230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:33.395544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.397029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.400620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553ea5-da2e-4fa5-8e25-b2818e6c168d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.409028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 522/1047] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:33.415408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.444286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.445436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.445853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.446132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.447087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:33.447703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.449410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.459464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 526/1048] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:33.464958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.520561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbe0ee-eef4-41e5-a4d0-447f157abe07 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.531305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.543015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.559154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.559811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.560134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.560417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.561255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] RBAC: Adding query filter params (role.id=24e74e95ec614d54b1a1083b6df0be30, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:33.561582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.563009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.569334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 523/1049] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=24e74e95ec614d54b1a1083b6df0be30 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:33.573736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa00302-8b0f-4252-a931-811c08246491 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.617228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.618047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.618340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.618615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] PATH_INFO: `/v3/users/62797543697f4276bb06e7f9d0e1d618` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.634140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] RBAC: Authorizing `identity:get_user(user_id=62797543697f4276bb06e7f9d0e1d618)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.635627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.637693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 527/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/users/62797543697f4276bb06e7f9d0e1d618 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:33.643304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:33.751610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f47c07-b69b-4f71-8f33-0fdef225a384 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:33.785536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:33.786180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:33.787018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:33.787299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:33.840707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:33.857976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:33.859413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:33.959585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 524/1051] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:33.965082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:34.064692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b299c-3a0f-4312-8f66-010254984f03 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:34.089529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:34.102536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:34.103398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:34.103685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:34.103976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:34.105166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:34.106586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fda253-9093-4d49-8cb2-c11b77c6a814 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:34.108519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 528/1052] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:33 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:34.114259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:34.199988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:34.217460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d1263-37f3-4dfe-aaf2-1364088be04f None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:34.251063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:34.251719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:34.252033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:34.252316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:34.253148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=2db4db1ac8e347eda53787472d11ea6b, user.id=62797543697f4276bb06e7f9d0e1d618) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:34.253469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:34.254896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080e33f-ca37-4284-bbee-ac78425272b4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:34.268060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 525/1053] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:34 2022] GET /identity/v3/role_assignments?user.id=62797543697f4276bb06e7f9d0e1d618&scope.project.id=2db4db1ac8e347eda53787472d11ea6b&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:35.012176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc65a0-8dbf-479c-976f-ec2716602188 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.012682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc65a0-8dbf-479c-976f-ec2716602188 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.012786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc65a0-8dbf-479c-976f-ec2716602188 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.014246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 529/1054] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:35.019174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.019541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.019739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.036934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:35.038113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:35.104624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 526/1055] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:35.127570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc65a0-8dbf-479c-976f-ec2716602188 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:35.229509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc65a0-8dbf-479c-976f-ec2716602188 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:35.263868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:35.264615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.264901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.265178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] PATH_INFO: `/v3/services/image` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.265834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:35.267198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:35.279334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:35.280591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 08:58:35.281838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:35.282973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 530/1056] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 23 08:58:35 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:35.287210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:35.367972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:35.390600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ee5a1-bab6-4690-b813-099efe26289f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:35.424927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:35.425596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.425887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.426164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.426869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] RBAC: Adding query filter params (name=image) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:35.427208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:35.428603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b175e3-7389-4fae-bc4c-9ef43ae9363a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:35.438028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 527/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:35.439229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:35.494431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:35.539798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e9ca-50b5-4c5e-818b-c458ea7b806c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:35.572421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:35.573082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.573370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.573664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.574352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] RBAC: Adding query filter params (type=image) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:35.574660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:35.576041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:35.581016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 531/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:35.587245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ae86-a19a-4511-8c3e-3824e9fa8590 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.587245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ae86-a19a-4511-8c3e-3824e9fa8590 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.587245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9ae86-a19a-4511-8c3e-3824e9fa8590 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.587245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 528/1059] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:35.589065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:35.591055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.591348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.591630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.612428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:35.613619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:35.684846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 529/1060] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:35.695669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cdb3-a4bd-4364-ab20-02c9b8d8aa93 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:35.707887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:35.713470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:35.732845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:35.733503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.733791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.734072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.734819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:35.736440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:35.763984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 532/1061] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 08:58:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:35.790533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:35.825459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38043eb6-283f-43cf-91aa-7daae1dbd7bb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:35.869019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:35.869859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:35.870146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:35.870427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:35.882704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:35.891178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:35.892254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:35.893153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:35.896716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 530/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:35.899300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.005969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111f02-7aa8-4f96-901b-64eaed15683d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.039884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.040744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.040915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.041173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.041927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:36.042235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.043591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.052779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 533/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:36.058516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.161678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213fbc5-5cf3-4d52-908b-79adf5f32d6c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.187630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.197459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.198262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.198547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.198824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.209646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.211095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-b128d417-75d8-4516-93fb-f7adba2f107f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:36.228087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:36.229001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:36.229930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:36.229930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:36.229930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:36.229930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:36.232017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 531/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:36.235017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.274160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.288776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dbbc-7448-4298-9b70-9c74bc8555cc None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.289061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dbbc-7448-4298-9b70-9c74bc8555cc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.289281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6dbbc-7448-4298-9b70-9c74bc8555cc None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.291091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 532/1065] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:36.295574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.295869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.296178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.313515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:36.314707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:36.346059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ee7d-99c5-447e-ba73-d1f882ca2b51 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.383243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.383901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.384217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.384496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.385219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:36.385534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.388005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 533/1066] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:36.388135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.401700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 534/1067] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:36.407110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.408479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.509444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.516491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562596d-77da-4b53-a964-01d2327d45f9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.521757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089583-9603-4cfa-b573-2bdf3bc63411 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.534029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.552929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.553655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.553946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.554233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.561462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.562361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.562643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.562916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.564457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:36.570431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.571859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:36.572451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:36.573368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:36.574229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:36.578804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 535/1068] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:36.579571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:36.589716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:36.590636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 534/1069] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:36.596768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.692012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ed14-5a91-4601-80f5-edbf55c0f772 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.709328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8f23-52a5-4bba-af74-dc1d19b71009 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.726336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.727007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.727296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.727584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.728366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:36.728682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.730047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.738191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 536/1070] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:36.744240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.747139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.748003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.748303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.748569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.749411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:36.749725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.751135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.763127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.777349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 535/1071] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:36.778363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.807700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:36.850295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e41c-c4dc-4b0c-a34c-5b4b7d093128 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.882698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a074a3-8219-48be-bffb-b34698f6f366 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:36.887641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.888574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.888863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.889144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] PATH_INFO: `/v3/users/62797543697f4276bb06e7f9d0e1d618` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.890593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] RBAC: Authorizing `identity:get_user(user_id=62797543697f4276bb06e7f9d0e1d618)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.892113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.899808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 537/1072] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/users/62797543697f4276bb06e7f9d0e1d618 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:36.900975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:36.921212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:36.922137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:36.922459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:36.922745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:36.933208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:36.934661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:36.952552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:36.954884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:36.956289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:36.956289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:36.956289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:36.956289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:36.956289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 536/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:36.960156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:37.001966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:37.018109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74dfc-5c12-40a0-b3ab-b426901daa0d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.045402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:37.057511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.058446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.058754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.059019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.060162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.061603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.063310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 538/1074] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:37.067282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c6522-fcfb-4fb3-879f-8f4267368f7c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.070268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:37.101906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.102565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.102848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.103126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.103846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:37.104313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.105670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.116661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 537/1075] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:37.122362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:37.174943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c11f-ffd4-4406-b825-8ff5491ef6fe None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.211051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.211940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.212254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.212537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b/users/62797543697f4276bb06e7f9d0e1d618/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.214535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4db1ac8e347eda53787472d11ea6b, user_id=62797543697f4276bb06e7f9d0e1d618, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.216002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.229354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 539/1076] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:37 2022] PUT /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b/users/62797543697f4276bb06e7f9d0e1d618/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:58:37.245009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60baa4c-5a20-496b-9209-5a3e2f03e423 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.283968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.284868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.285165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.285451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.293374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.294861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.298271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:37.311994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:37.312977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:37.319332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 538/1077] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:37.322387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:37.340372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:37.432921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87befe-569f-43ac-99ec-d8d9831049d9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.467104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.467820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.468137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.468417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.469206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:37.469519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.470930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa246168-113c-448f-b2c5-e10d475cd887 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.483277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 540/1078] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:37.489296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:37.596211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446a77e-8677-4e09-b447-7ad528533e32 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:37.635620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:37.636534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.636813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.637083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/24e74e95ec614d54b1a1083b6df0be30` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.639279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=b8fc0436447946d6b65f0ec3880a0c38, role_id=24e74e95ec614d54b1a1083b6df0be30)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:37.640713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f50b-bf06-4bcb-a7dd-b376c0652fa9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:37.654336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 539/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:37 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/b8fc0436447946d6b65f0ec3880a0c38/roles/24e74e95ec614d54b1a1083b6df0be30 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 08:58:37.846748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9ebc-83b8-440d-9c88-5eb108a7070a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.847093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9ebc-83b8-440d-9c88-5eb108a7070a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.847209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e9ebc-83b8-440d-9c88-5eb108a7070a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.848652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 541/1080] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:37.853895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:37.854179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:37.854462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:37.871614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:37.872826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:37.929539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:37.943419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 540/1081] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:37.965279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e9ebc-83b8-440d-9c88-5eb108a7070a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:38.042129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:38.069711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e9ebc-83b8-440d-9c88-5eb108a7070a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:38.107349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:38.107919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:38.108236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:38.108517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:38.174682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:38.176155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:38.248324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:38.274810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 542/1082] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:38.280579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:38.382988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ee6e-8a18-4de7-bd31-032779411988 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:38.417755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:38.418555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:38.418843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:38.419122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:38.429237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:38.430680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d5cb79d3-9e9f-40cb-bf31-20ae59e01a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:38.451285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:38.453264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:38.454214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:38.454214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:38.454214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:38.454214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:38.454214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 541/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:38.459167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:38.559320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d674c71-2338-416c-af13-a17f23846fa0 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:38.597315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:38.599982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:38.599982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:38.599982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:38.599982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:38.600293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:38.601474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f67f6-69bf-48fd-beed-ab2a8bf71566 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:38.620004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 543/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:39.303118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1de6e-213a-47f4-afb4-c6aec898e83a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.303709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1de6e-213a-47f4-afb4-c6aec898e83a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.303709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1de6e-213a-47f4-afb4-c6aec898e83a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.305170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 542/1085] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:39.310490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058689-cf11-45cb-b956-0caafff918fa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.310883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058689-cf11-45cb-b956-0caafff918fa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.311122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058689-cf11-45cb-b956-0caafff918fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.328507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-02058689-cf11-45cb-b956-0caafff918fa None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:39.329694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-02058689-cf11-45cb-b956-0caafff918fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:39.355185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:39.394901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 544/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:39.418705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1de6e-213a-47f4-afb4-c6aec898e83a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.466181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:39.522928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1de6e-213a-47f4-afb4-c6aec898e83a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:39.556357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:39.557073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.557356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.557632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.567739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f5a5b74d-9622-43a0-9ca4-590c9d8a6066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:39.575398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:39.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:39.577822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 543/1087] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:39.582512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02058689-cf11-45cb-b956-0caafff918fa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.683890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02058689-cf11-45cb-b956-0caafff918fa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:39.701648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073480f-1bc4-440e-a758-50c5a0abc166 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.702042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073480f-1bc4-440e-a758-50c5a0abc166 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.702395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073480f-1bc4-440e-a758-50c5a0abc166 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.703859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 544/1088] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:58:39.708841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.709158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.709445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.717919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:39.718577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.718861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.719136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.719881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:39.720232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:39.721597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:39.726252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:39.727435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:39.730377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 545/1089] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:39.735606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.763467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:39.795168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 545/1090] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:39.818831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.834469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e0a6-c293-4819-8f10-e95d2d64fdb9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:39.847858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:39.868333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:39.869207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.869487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.869761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] PATH_INFO: `/v3/users/62797543697f4276bb06e7f9d0e1d618` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.870954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] RBAC: Authorizing `identity:get_user(user_id=62797543697f4276bb06e7f9d0e1d618)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:39.872415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:39.874051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 546/1091] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/users/62797543697f4276bb06e7f9d0e1d618 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:39.879630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.918182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d60f3-ea94-46a8-8034-018e6012b29d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:39.951650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:39.952491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:39.952778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:39.953057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:39.963444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:39.971662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:39.972699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 08:58:39.973636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:39.975063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:39.975150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 546/1092] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:39.979366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:39.982345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0407b4-e453-4445-bfa3-e276329748e2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.014689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.015336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.015628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.015910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.072752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.081495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81b3a0-7cff-43d6-aaf9-01d6119b67b6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.082833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.084819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.115678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.116377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.116666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.116946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.117694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:40.118009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.119367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.127409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 547/1093] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:40.133426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.176548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.185068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 547/1094] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 08:58:40.190905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.232467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb88e-f26c-4a75-bf33-3512c6f810ee None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.265059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.265869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.266153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.266432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.277254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.278676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.287496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3157d-1f28-4709-abc7-16f34d2d7752 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:40.295757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:40.296683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:40.297581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:40.297581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:40.297581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:40.297581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:40.297581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 548/1095] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:40.302757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.311508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.325774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.326579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.326861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.327137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.328334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.329759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.337306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 548/1096] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:40.337928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.396924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.404073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56617-aa62-4e7f-8d84-9f65eb28b150 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.435103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26850e-608f-41e0-bf50-db4a0d3364bd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.436989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.437650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.437936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.438212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.438931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:40.439239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.440623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.452838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 549/1097] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:40.459009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.469110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.469768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.470056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.470330 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.471159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=2db4db1ac8e347eda53787472d11ea6b, user.id=62797543697f4276bb06e7f9d0e1d618) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:40.471476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.472934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.480631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 549/1098] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/role_assignments?user.id=62797543697f4276bb06e7f9d0e1d618&scope.project.id=2db4db1ac8e347eda53787472d11ea6b&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 08:58:40.527925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.568784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35eb45-8f4f-4865-9423-7faa693eb0ec None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.605344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.606163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.606451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.606731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.615198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.616689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 08:58:40.632351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:40.633382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:40.634368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 550/1099] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 08:58:40.639323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.737445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdbac8-e94c-47eb-b421-49694b56d2d8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.762710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.774994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.775681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.775989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.776275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:40.777403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:40.777984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:40.779940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:40.799014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 550/1100] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:40.805068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:40.905990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0f03-7395-4a2f-9a1a-008820701af2 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:40.931575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:40.940357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:40.941006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:40.941293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:40.941826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.007693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.009181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.105129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 551/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:41.110960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:41.209240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098e17-c569-4c61-83b5-4a49e3b48295 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:41.242247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:41.243036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:41.243320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:41.243595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.253411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.254848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:58:41.272451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:41.273561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:41.275076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 08:58:41.275076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:58:41.275076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 08:58:41.275076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:41.275076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 551/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:41.279208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:41.305784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:41.376489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ce28-25d9-4018-b8d7-7b0041fbb358 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:41.409308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:41.409963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:41.410250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:41.410534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.411309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:41.411629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.413030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.423978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 552/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 08:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:41.429920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:41.463680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:41.526652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbf22d-0fde-4dd2-bbb1-5f3fcd44fe2c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:41.558819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:41.559597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:41.559880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:41.560188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.566913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.568909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 08:58:41.582336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:41.583384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 08:58:41.584509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:58:41.588407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 552/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 08:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:41.589651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:41.676024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:41.692018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945166c2-77d0-4917-b9cc-4bc1e991d6fe None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:41.727980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:41.728743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:41.729035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:41.729319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.730110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:41.730429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.731854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab0bf-7409-424d-9915-414672da2232 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.744340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 553/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 08:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:41.750280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:41.840382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:41.846563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79738c-a18e-4505-b2ba-ba5373ef0e4b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:41.879152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:41.879786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:41.880134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:41.880416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:41.881243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] RBAC: Adding query filter params (role.id=24e74e95ec614d54b1a1083b6df0be30, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=b8fc0436447946d6b65f0ec3880a0c38) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:41.881558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:41.882972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c00bd8-4248-434b-b01f-dd53114710d1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:41.888652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 553/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:41 2022] GET /identity/v3/role_assignments?user.id=b8fc0436447946d6b65f0ec3880a0c38&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=24e74e95ec614d54b1a1083b6df0be30 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:42.560003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3748ba-e6b7-44ca-a6a2-489ac3d83db3 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:42.560515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3748ba-e6b7-44ca-a6a2-489ac3d83db3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:42.560609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3748ba-e6b7-44ca-a6a2-489ac3d83db3 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:42.561956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 554/1107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:42.568260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:42.568694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:42.568817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:42.586160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:42.587352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:42.655449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 554/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:42.680148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3748ba-e6b7-44ca-a6a2-489ac3d83db3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:42.779156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3748ba-e6b7-44ca-a6a2-489ac3d83db3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:42.811428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:42.812173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:42.812457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:42.812733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:42.813887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:42.815306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19119d36-db27-4b8f-bc32-b39268cc1e70 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:42.817181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 555/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:42.823620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:42.909070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:42.918701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ba187-a82c-452a-b8c8-1ff4c2b65949 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:42.952210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:42.952868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:42.953157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:42.953437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:42.954146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:42.955565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab3a2-f84b-4bc1-ad42-906f13ff0f3d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:42.974431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 555/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:58:42 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:45.034922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9588ac-4cf9-437a-b0df-92c6ba4e4abf None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.035451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9588ac-4cf9-437a-b0df-92c6ba4e4abf None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.035543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9588ac-4cf9-437a-b0df-92c6ba4e4abf None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.036900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 556/1111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:45.042066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.042466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.042633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.059492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:45.060706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:45.133775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 556/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:45.156855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9588ac-4cf9-437a-b0df-92c6ba4e4abf None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:45.172214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:45.256716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9588ac-4cf9-437a-b0df-92c6ba4e4abf None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:45.288369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:45.289144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.289426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.289699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] PATH_INFO: `/v3/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.291143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] RBAC: Authorizing `identity:get_role(role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:45.292521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:45.293868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 557/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:45 2022] GET /identity/v3/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:45.299472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:45.375700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:45.398913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17830a58-2bda-4185-b8dc-6d3ecfc9de7d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:45.431651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:45.432533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.432815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.433089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] PATH_INFO: `/v3/users/75734daffa274c99841d13744cce8bb0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.445773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] RBAC: Authorizing `identity:get_user(user_id=75734daffa274c99841d13744cce8bb0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:45.447197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:45.448842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 557/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:45 2022] GET /identity/v3/users/75734daffa274c99841d13744cce8bb0 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:45.454585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:45.532894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:45.550835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a9adc-8f6a-4d4a-a450-92fb17c31954 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:45.583629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:45.584373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.584662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.584944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.649388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:45.650828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:45.727101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:45.745682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 558/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:45.751491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:45.846204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e208-2de9-4d15-98c3-1e8842a21017 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:45.878246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:45.879084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:45.879367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:45.879644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:45.880863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:45.882276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596845b-f426-4b0e-9d1f-3401ead68caa None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:45.883932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 558/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:45 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:45.889652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:45.984154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9caddb-c385-4076-87b7-30573f63f07e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:46.015961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:46.016609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:46.016891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:46.017165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:46.017986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=2db4db1ac8e347eda53787472d11ea6b, user.id=75734daffa274c99841d13744cce8bb0) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:46.018298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:46.019708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689edb43-bc82-4d82-b685-3829b877a8e3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:46.025516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 559/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:45 2022] GET /identity/v3/role_assignments?user.id=75734daffa274c99841d13744cce8bb0&scope.project.id=2db4db1ac8e347eda53787472d11ea6b&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:48.010745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923d45-2983-43e0-bd22-87760229f854 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.011243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923d45-2983-43e0-bd22-87760229f854 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.011335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c923d45-2983-43e0-bd22-87760229f854 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.012713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 559/1118] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:48.017904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.018303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.018463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.034896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:48.036140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:48.077387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:48.101209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 560/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:48.124118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923d45-2983-43e0-bd22-87760229f854 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:48.126953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:48.221594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c923d45-2983-43e0-bd22-87760229f854 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:48.253604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:48.254440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.254720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.255575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] PATH_INFO: `/v3/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.257057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] RBAC: Authorizing `identity:get_role(role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:48.258409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:48.259746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 560/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:48 2022] GET /identity/v3/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:48.265626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:48.359525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e496d29-c11a-433d-9c55-c7cf3c03c903 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:48.396017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:48.396897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.397182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.397459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] PATH_INFO: `/v3/users/75734daffa274c99841d13744cce8bb0` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.398641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] RBAC: Authorizing `identity:get_user(user_id=75734daffa274c99841d13744cce8bb0)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:48.400092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:48.401731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 561/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:48 2022] GET /identity/v3/users/75734daffa274c99841d13744cce8bb0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:48.407493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:48.477197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:48.506541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7969f-ebbc-456e-93ba-6073339f315a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:48.539301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:48.540118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.540404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.540680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.541842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:48.543256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10660a99-59e4-4e01-8aad-e500d7f6a064 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:48.544969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 561/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:48 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:48.550865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:48.595910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:48.651554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfda04-6c6b-47af-b1eb-535b64e47820 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:48.684849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:48.685733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:48.686023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:48.686301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b/users/75734daffa274c99841d13744cce8bb0/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:48.688514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] RBAC: Authorizing `identity:create_grant(project_id=2db4db1ac8e347eda53787472d11ea6b, user_id=75734daffa274c99841d13744cce8bb0, role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:48.689953 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb4eb2-f042-4a9a-b987-a350f0953933 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:48.702429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 562/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:58:48 2022] PUT /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b/users/75734daffa274c99841d13744cce8bb0/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:58:50.668226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dbcf1-4db4-4f8b-891d-1828a0e05ecb None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:50.668762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dbcf1-4db4-4f8b-891d-1828a0e05ecb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:50.668762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dbcf1-4db4-4f8b-891d-1828a0e05ecb None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:50.670164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 562/1124] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:50.675445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:50.675853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:50.676038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:50.693062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:50.694237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:50.757867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 563/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:50.781317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dbcf1-4db4-4f8b-891d-1828a0e05ecb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:50.879654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dbcf1-4db4-4f8b-891d-1828a0e05ecb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:50.912155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:50.912999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:50.913289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:50.913572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] PATH_INFO: `/v3/roles/2f5b3e84a59b4678a2c079bb718c8895` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:50.915056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] RBAC: Authorizing `identity:get_role(role_id=2f5b3e84a59b4678a2c079bb718c8895)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:50.916459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:50.917797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 563/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:50 2022] GET /identity/v3/roles/2f5b3e84a59b4678a2c079bb718c8895 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:50.923374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:50.956179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:51.021710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865127b-a95b-4e9c-93b0-fc5aa4090cb7 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:51.054432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:51.055292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:51.055581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:51.055859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] PATH_INFO: `/v3/users/75734daffa274c99841d13744cce8bb0` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:51.057063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] RBAC: Authorizing `identity:get_user(user_id=75734daffa274c99841d13744cce8bb0)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:51.058474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:51.060109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 564/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:50 2022] GET /identity/v3/users/75734daffa274c99841d13744cce8bb0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:51.065714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:51.074620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:51.163901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e49b6-0c4c-434b-a47b-c8d979e354fd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:51.196214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:51.196857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:51.197147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:51.197428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:51.261842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:51.263276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:51.271060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:51.358496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 564/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:51.364478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:51.461072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2b51-0c6c-4b4b-bc2d-d02baafc90b9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:51.462462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:51.493839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:51.494729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:51.494994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:51.495270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] PATH_INFO: `/v3/projects/2db4db1ac8e347eda53787472d11ea6b` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:51.496455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] RBAC: Authorizing `identity:get_project(project_id=2db4db1ac8e347eda53787472d11ea6b)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:51.497894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066814d8-68d2-4567-829e-05452bcda561 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:51.499564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 565/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:51 2022] GET /identity/v3/projects/2db4db1ac8e347eda53787472d11ea6b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:51.505919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:51.601594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01d75e-6687-47a6-948a-3547cdbf2afd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:51.608887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:51.635287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:51.635926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:51.636240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:51.636517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:51.637343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] RBAC: Adding query filter params (role.id=2f5b3e84a59b4678a2c079bb718c8895, scope.project.id=2db4db1ac8e347eda53787472d11ea6b, user.id=75734daffa274c99841d13744cce8bb0) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:51.637657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:51.639068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ec614-c396-4e68-81a5-2f7005869e91 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:51.644736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 565/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:51 2022] GET /identity/v3/role_assignments?user.id=75734daffa274c99841d13744cce8bb0&scope.project.id=2db4db1ac8e347eda53787472d11ea6b&role.id=2f5b3e84a59b4678a2c079bb718c8895 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:53.682139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e187-7f5a-42af-ac28-828292994926 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:53.682657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e187-7f5a-42af-ac28-828292994926 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:53.682756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e187-7f5a-42af-ac28-828292994926 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:53.684122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 566/1131] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:53.689262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:53.689646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:53.689827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:53.706476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:53.707668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:53.772382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 566/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:53.795741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e187-7f5a-42af-ac28-828292994926 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:53.898556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e187-7f5a-42af-ac28-828292994926 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:53.931664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:53.932468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:53.932751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:53.933027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:53.934184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:53.935610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d071-ae1c-45af-afa8-49663ba2a7ff None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:53.937240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 567/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:53.943306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:54.035496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:54.038891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd902747-495c-4640-b1e2-696e02fd21c2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:54.071923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:54.072606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:54.072896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:54.073178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:54.073900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:54.075318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f456a8-da57-469a-a5a5-ee15887321fd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:54.099970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 567/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:58:53 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 08:58:56.121344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0fc6-09fb-497e-87e9-1928bb101c92 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:56.121902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0fc6-09fb-497e-87e9-1928bb101c92 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:56.121997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0fc6-09fb-497e-87e9-1928bb101c92 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:56.124340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 568/1135] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:56.130603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:56.131040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:56.131171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:56.147758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:56.149543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:56.214784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 568/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:58:56.238805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0fc6-09fb-497e-87e9-1928bb101c92 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:56.279245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:56.340444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0fc6-09fb-497e-87e9-1928bb101c92 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:56.373690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:56.374414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:56.374698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:56.374976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:56.376312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:56.377736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e77638-12ab-4519-b4e6-8b59217fed63 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:56.379339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 569/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 08:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:56.385777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:56.464161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:56.482196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a74a-341a-41c7-bc68-c2908fdcd2cc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:56.515328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:56.516014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:56.516305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:56.516586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:56.517304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:56.518728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f603030-8a3f-4450-a75f-43f606f4e7f5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:56.537633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 569/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:58:56 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:58:58.564333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0299-db90-4469-b5cd-7f8aecef31fa None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:58.564879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0299-db90-4469-b5cd-7f8aecef31fa None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:58.564879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0299-db90-4469-b5cd-7f8aecef31fa None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:58.566267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 570/1139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:58:58.571803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:58.572258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:58.572407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:58.593331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:58:58.594525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:58:58.662315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 570/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 08:58:58.685543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0299-db90-4469-b5cd-7f8aecef31fa None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:58.785645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0299-db90-4469-b5cd-7f8aecef31fa None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:58.793591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:58.819746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:58.820505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:58.820794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:58.821074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:58.830816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:58:58.839011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:58:58.840199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:58:58.841456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 571/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:58:58.846227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:58.917819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:58.950138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dc30-516f-434b-95e1-8600520ffc84 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:58.982427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:58.983080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:58.983365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:58.983643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:58.984418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:58.984728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:58.986091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:58.994391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 571/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:59.000206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:59.097234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4361-65de-484e-bab8-3ba2004ce329 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:59.130080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:59.130935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:59.131215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:59.131488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] PATH_INFO: `/v3/users/31457ee3cf30497cb10634436922f844` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:59.144041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] RBAC: Authorizing `identity:get_user(user_id=31457ee3cf30497cb10634436922f844)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:59.145495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:59.147104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 572/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:58:58 2022] GET /identity/v3/users/31457ee3cf30497cb10634436922f844 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:59.152786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:59.249226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e09f9-3cf6-4685-9f65-ac870d6f9abf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:59.276962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:59.283023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:59.283662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:59.283966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:59.284247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:59.349878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:59.351263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:59.444156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 572/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:58:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:58:59.449987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:59.475468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:59.547708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91baa6-99f0-462d-af6f-99e84b2f8a0a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:59.580452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:59.581305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:59.581591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:59.581878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] PATH_INFO: `/v3/projects/faaf33f6ff1e412da277fc0e6d78df78` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:59.583561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] RBAC: Authorizing `identity:get_project(project_id=faaf33f6ff1e412da277fc0e6d78df78)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:59.585042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea8ca-7ff5-4dd9-859f-01c553361941 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:59.586952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 573/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:58:59 2022] GET /identity/v3/projects/faaf33f6ff1e412da277fc0e6d78df78 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:58:59.592750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:58:59.621951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:58:59.689600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a55d4-dee5-4d74-b399-1524d0c4f1b5 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:58:59.723167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:58:59.723838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:58:59.724191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:58:59.724473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:58:59.725298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=faaf33f6ff1e412da277fc0e6d78df78, user.id=31457ee3cf30497cb10634436922f844) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:58:59.725613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:58:59.727024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed45a9-47ea-46e2-a8b8-651d038b3f8b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:58:59.732342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 573/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:58:59 2022] GET /identity/v3/role_assignments?user.id=31457ee3cf30497cb10634436922f844&scope.project.id=faaf33f6ff1e412da277fc0e6d78df78&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:01.687194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e12d0-11da-4053-90e9-e264c622a1b5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:01.687740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e12d0-11da-4053-90e9-e264c622a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:01.687740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e12d0-11da-4053-90e9-e264c622a1b5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:01.689196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 574/1147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:01.695059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:01.695438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:01.695609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:01.711800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:01.713017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:01.777247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 574/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:01.799026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e12d0-11da-4053-90e9-e264c622a1b5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:01.888900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:01.898516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e12d0-11da-4053-90e9-e264c622a1b5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:01.931920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:01.932727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:01.933013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:01.933297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:01.943413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:59:01.951084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:01.952225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:59:01.953303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 575/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:01.958362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:01.982987 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:02.055186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59028c7-4e17-467a-8704-5eb7386a7db2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:02.087699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:02.088392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:02.088679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:02.088956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:02.089701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:02.090015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:02.091374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:02.099633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 575/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:02.105314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:02.202065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44487d8c-a027-4566-b361-f3754235c2fb None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:02.234329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:02.235188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:02.235477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:02.235761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] PATH_INFO: `/v3/users/31457ee3cf30497cb10634436922f844` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:02.236979 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] RBAC: Authorizing `identity:get_user(user_id=31457ee3cf30497cb10634436922f844)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:02.238398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:02.240659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 576/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:59:02 2022] GET /identity/v3/users/31457ee3cf30497cb10634436922f844 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:02.246117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:02.327150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:02.342551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea8535-77e8-418c-97c2-fe080d9969cc None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:02.376490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:02.377338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:02.377622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:02.377898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] PATH_INFO: `/v3/projects/faaf33f6ff1e412da277fc0e6d78df78` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:02.379056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] RBAC: Authorizing `identity:get_project(project_id=faaf33f6ff1e412da277fc0e6d78df78)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:02.380531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e54e-63e6-4637-b9ff-b40d910a578a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:02.382207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 576/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:59:02 2022] GET /identity/v3/projects/faaf33f6ff1e412da277fc0e6d78df78 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:02.388026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:02.411409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:02.485294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a06ca-ccf6-423b-81ec-d1ffcf433568 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:02.516590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:02.517461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:02.517745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:02.518020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] PATH_INFO: `/v3/projects/faaf33f6ff1e412da277fc0e6d78df78/users/31457ee3cf30497cb10634436922f844/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:02.519947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] RBAC: Authorizing `identity:create_grant(project_id=faaf33f6ff1e412da277fc0e6d78df78, user_id=31457ee3cf30497cb10634436922f844, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:02.521867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043389-9290-4be3-8c69-7ad2b0a2ed86 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:02.534667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 577/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:59:02 2022] PUT /identity/v3/projects/faaf33f6ff1e412da277fc0e6d78df78/users/31457ee3cf30497cb10634436922f844/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:59:04.498903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6852-5850-467f-a83e-7ea8ca764982 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:04.499428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6852-5850-467f-a83e-7ea8ca764982 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:04.499518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c6852-5850-467f-a83e-7ea8ca764982 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:04.500907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 577/1154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:04.506503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:04.506935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:04.507042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:04.523274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:04.524480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:04.588324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 578/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:04.611328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c6852-5850-467f-a83e-7ea8ca764982 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:04.710962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c6852-5850-467f-a83e-7ea8ca764982 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:04.743240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:04.744046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:04.744338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:04.744619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:04.754391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:59:04.762616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:04.763731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:59:04.764831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 578/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:04.769788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:04.781259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:04.866848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf8255-5491-4065-bf1d-afac84200842 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:04.899115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:04.899764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:04.900077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:04.900356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:04.901094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:04.901403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:04.902748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:04.910485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 579/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:04.916593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:04.932880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:05.014451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e333b-c25a-4aa9-8873-52d5d9f2f6dd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:05.046708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:05.047554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:05.047839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:05.048145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] PATH_INFO: `/v3/users/31457ee3cf30497cb10634436922f844` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:05.049322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] RBAC: Authorizing `identity:get_user(user_id=31457ee3cf30497cb10634436922f844)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:05.050739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:05.052949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 579/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:59:04 2022] GET /identity/v3/users/31457ee3cf30497cb10634436922f844 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:05.058468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:05.126210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:05.154987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa3755-7379-4ce6-8c30-9394ab10c8c5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:05.187458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:05.188118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:05.188404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:05.188681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:05.252722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:05.254151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:05.318483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:05.349097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 580/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:59:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:59:05.354892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:05.432963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:05.450991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeece3c-f263-4bb9-9fc9-dc0c564b9014 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:05.483584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:05.484461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:05.484748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:05.485027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] PATH_INFO: `/v3/projects/faaf33f6ff1e412da277fc0e6d78df78` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:05.486193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] RBAC: Authorizing `identity:get_project(project_id=faaf33f6ff1e412da277fc0e6d78df78)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:05.487615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d72930-6f52-4502-bc27-7de42d0c7f66 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:05.489336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 580/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:59:05 2022] GET /identity/v3/projects/faaf33f6ff1e412da277fc0e6d78df78 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:05.495300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:05.590524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a0479-a7a7-4c65-85c3-c0ac56cc6920 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:05.624362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:05.625012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:05.625301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:05.625583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:05.626420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=faaf33f6ff1e412da277fc0e6d78df78, user.id=31457ee3cf30497cb10634436922f844) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:05.626738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:05.628174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd55de-b4fe-4d39-9a3f-53fe98d25497 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:05.634359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 581/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:59:05 2022] GET /identity/v3/role_assignments?user.id=31457ee3cf30497cb10634436922f844&scope.project.id=faaf33f6ff1e412da277fc0e6d78df78&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:07.662062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ae1c-80db-4376-8cb4-a79ed37edee3 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:07.662543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ae1c-80db-4376-8cb4-a79ed37edee3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:07.662662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ae1c-80db-4376-8cb4-a79ed37edee3 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:07.664064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 581/1162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:07.669143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:07.669547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:07.669707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:07.686503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:07.687686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:07.715939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:07.752608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 582/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:07.775066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ae1c-80db-4376-8cb4-a79ed37edee3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:07.873330 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ae1c-80db-4376-8cb4-a79ed37edee3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:07.905746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:07.906373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:07.906660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:07.906939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:07.924708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:07.971692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:07.973659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:08.067004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 582/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:59:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:59:08.072863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:08.166390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a47bf-8641-4dff-967e-0388b8f8169f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:08.198714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:08.199494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:08.199776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:08.200079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:08.206758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:08.208249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-eb8befe4-feb4-4e54-87bc-df43d4a1a7a0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:08.221935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:08.223679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:59:08.225000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 583/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 08:59:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:08.230713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:08.280193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:08.327584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac21dbd-4ea2-47a4-b535-5b019d3cbd5c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:08.360425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:08.361067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:08.361351 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:08.361626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:08.362336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:08.362645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:08.364232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af93d-621a-43d9-ab42-5e461e01bc16 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:08.371110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 583/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 23 08:59:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:10.381075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814cb27-4ae4-49f0-aee3-08419f3f7ca1 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:10.381636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814cb27-4ae4-49f0-aee3-08419f3f7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:10.381636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814cb27-4ae4-49f0-aee3-08419f3f7ca1 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:10.383004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 584/1167] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:10.388374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e262-0e77-4479-be28-aca9a7ee0c67 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:10.388768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e262-0e77-4479-be28-aca9a7ee0c67 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:10.388943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e262-0e77-4479-be28-aca9a7ee0c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:10.405958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4371e262-0e77-4479-be28-aca9a7ee0c67 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:10.407151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4371e262-0e77-4479-be28-aca9a7ee0c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:10.472714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 584/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:10.496386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814cb27-4ae4-49f0-aee3-08419f3f7ca1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:10.524203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:10.595867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814cb27-4ae4-49f0-aee3-08419f3f7ca1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:10.628556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:10.629210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:10.630050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:10.630325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:10.631159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:10.632474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94660d11-0753-40de-af4f-5cd4a8dea7a3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:10.647052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 585/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Jun 23 08:59:10 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:59:12.664131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36be3cc-1b73-46a0-b705-49484e6267a7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:12.664670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36be3cc-1b73-46a0-b705-49484e6267a7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:12.664670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36be3cc-1b73-46a0-b705-49484e6267a7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:12.666073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 585/1170] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:12.671102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b126b-1034-4379-9478-89254465d937 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:12.671518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b126b-1034-4379-9478-89254465d937 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:12.671664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b126b-1034-4379-9478-89254465d937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:12.687914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-974b126b-1034-4379-9478-89254465d937 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:12.689115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-974b126b-1034-4379-9478-89254465d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:12.755112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 586/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:12.778032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36be3cc-1b73-46a0-b705-49484e6267a7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:12.824016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:12.876627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36be3cc-1b73-46a0-b705-49484e6267a7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:12.914713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:12.915571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:12.915859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:12.916162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] PATH_INFO: `/v3/domains/a659112b4c6e4501a35ca5a7b9c646d7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:12.926715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a659112b4c6e4501a35ca5a7b9c646d7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:12.928179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d022abc-a5b5-49f3-9bbe-913cbbf9f747 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:12.929802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 586/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jun 23 08:59:12 2022] GET /identity/v3/domains/a659112b4c6e4501a35ca5a7b9c646d7 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:12.935563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b126b-1034-4379-9478-89254465d937 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:12.953185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:13.031581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b126b-1034-4379-9478-89254465d937 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:13.064390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5589f-c402-428d-825e-2100690218ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:13.065039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5589f-c402-428d-825e-2100690218ce None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:13.065326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5589f-c402-428d-825e-2100690218ce None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:13.065607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5589f-c402-428d-825e-2100690218ce None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:13.066322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5589f-c402-428d-825e-2100690218ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:13.068607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5589f-c402-428d-825e-2100690218ce None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:13.092153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 587/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 08:59:12 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:59:15.138921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7908ca-abd9-4037-94cd-cf51bf82d967 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:15.139444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7908ca-abd9-4037-94cd-cf51bf82d967 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:15.139539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7908ca-abd9-4037-94cd-cf51bf82d967 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:15.140896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 587/1174] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:15.145988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:15.146358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:15.146546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:15.164525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:15.165700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:15.225345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:15.231557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 588/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:15.256710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7908ca-abd9-4037-94cd-cf51bf82d967 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:15.354446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7908ca-abd9-4037-94cd-cf51bf82d967 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:15.356703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:15.387856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:15.388734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:15.389068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:15.389297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] PATH_INFO: `/v3/domains/a659112b4c6e4501a35ca5a7b9c646d7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:15.390471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a659112b4c6e4501a35ca5a7b9c646d7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:15.391888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077fc7-95d2-46f5-a7e1-a6cbe781f690 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:15.393512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 588/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jun 23 08:59:15 2022] GET /identity/v3/domains/a659112b4c6e4501a35ca5a7b9c646d7 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:15.399025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:15.494149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538be1-d451-4985-8ee0-8e4dbc18900a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:15.526059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:15.526709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:15.526998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:15.527274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:15.528012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:15.529426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384f95a-a24d-440f-8087-d5d44e245880 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:15.548664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 589/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 08:59:15 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 08:59:17.618590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb2f4-5228-4b40-a248-8d8bffed465c None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:17.619078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb2f4-5228-4b40-a248-8d8bffed465c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:17.619170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecb2f4-5228-4b40-a248-8d8bffed465c None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:17.620571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 589/1178] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:17.625599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054464e3-368c-426b-be38-0e59529dd36e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:17.625987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054464e3-368c-426b-be38-0e59529dd36e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:17.626160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054464e3-368c-426b-be38-0e59529dd36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:17.643124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-054464e3-368c-426b-be38-0e59529dd36e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:17.644468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-054464e3-368c-426b-be38-0e59529dd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:17.692919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:17.710447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 590/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:17.733418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb2f4-5228-4b40-a248-8d8bffed465c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:17.829109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecb2f4-5228-4b40-a248-8d8bffed465c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:17.861245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:17.861954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:17.862236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:17.862511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:17.872213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:59:17.880350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:17.881442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:59:17.882503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 590/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:17.887349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054464e3-368c-426b-be38-0e59529dd36e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:17.982263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054464e3-368c-426b-be38-0e59529dd36e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:18.015224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:18.015875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:18.016193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:18.016474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:18.017216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:18.017528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:18.018881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:18.026657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 591/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:18.032157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:18.063036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:18.130001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597d01-8d56-4b82-8ed5-d5e71b194ff1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:18.161654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:18.162510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:18.162798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:18.163080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] PATH_INFO: `/v3/users/42d03abd29d3498b9ad0434dda27424f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:18.175688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=42d03abd29d3498b9ad0434dda27424f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:18.177690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:18.179314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 591/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:59:18 2022] GET /identity/v3/users/42d03abd29d3498b9ad0434dda27424f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:18.184961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:18.232653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:18.284404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155e39-609b-4cd5-952e-0753f7f8829c None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:18.316470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:18.317937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:18.318224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:18.318504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:18.384228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:18.385606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:18.428610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:18.480688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 592/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:59:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:59:18.486635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:18.575692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:18.585564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f22a43-a3af-48ce-a129-2e6931ab0ac9 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:18.623915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:18.624796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:18.625077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:18.625350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] PATH_INFO: `/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:18.626513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] RBAC: Authorizing `identity:get_project(project_id=5bdcff1b6f744bdb8c7f047aba22c095)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:18.627929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716d8e0-da23-4af4-9b26-6abd2efad8ba None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:18.629645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 592/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:59:18 2022] GET /identity/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:18.635786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:18.737165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c75c1-f9d9-4b6a-92f0-fcd9e7fcb83b None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:18.770296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:18.770937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:18.771216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:18.771487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:18.772339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=5bdcff1b6f744bdb8c7f047aba22c095, user.id=42d03abd29d3498b9ad0434dda27424f) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:18.772654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:18.774060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7edc8-284b-4441-ac0b-f3b3c93693ac None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:18.779290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 593/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:59:18 2022] GET /identity/v3/role_assignments?user.id=42d03abd29d3498b9ad0434dda27424f&scope.project.id=5bdcff1b6f744bdb8c7f047aba22c095&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:20.759049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82df3-15c6-4a70-8ea8-ceaf8a5950ee None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:20.759635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82df3-15c6-4a70-8ea8-ceaf8a5950ee None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:20.759635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82df3-15c6-4a70-8ea8-ceaf8a5950ee None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:20.761006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 593/1186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 08:59:20.766267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:20.766659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:20.766842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:20.783944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:20.785310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:20.788079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:20.852404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 594/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:20.874928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82df3-15c6-4a70-8ea8-ceaf8a5950ee None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:20.971795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82df3-15c6-4a70-8ea8-ceaf8a5950ee None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:21.005305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:21.006074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:21.006359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:21.006635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:21.016419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:59:21.024065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:21.025278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 08:59:21.026426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 594/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:21.031249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:21.125196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35f937-137e-4df8-b9ac-910c6f62290a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:21.157380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:21.158024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:21.158309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:21.158586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:21.159325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:21.159634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:21.161044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:21.168777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 595/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:21.174366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:21.194459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:21.271566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d6b2-5bbd-4d13-ab9c-ec955def42f8 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:21.303539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:21.304416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:21.304703 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:21.304982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] PATH_INFO: `/v3/users/42d03abd29d3498b9ad0434dda27424f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:21.306159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] RBAC: Authorizing `identity:get_user(user_id=42d03abd29d3498b9ad0434dda27424f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:21.307583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:21.309226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 595/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:59:21 2022] GET /identity/v3/users/42d03abd29d3498b9ad0434dda27424f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:21.314795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:21.318249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:21.413044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014537-541a-43c7-8bf5-7c61dc31c3a5 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:21.445373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:21.446211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:21.446492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:21.446765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] PATH_INFO: `/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:21.447926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] RBAC: Authorizing `identity:get_project(project_id=5bdcff1b6f744bdb8c7f047aba22c095)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:21.449385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4cf79-0d53-47df-88f8-c51413cd270d None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:21.451056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 596/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:59:21 2022] GET /identity/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:21.456818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:21.538946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:21.556868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67302b-78b1-4d9a-aa2c-24b05b144f61 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:21.594751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:21.595642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:21.595932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:21.596241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] PATH_INFO: `/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095/users/42d03abd29d3498b9ad0434dda27424f/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:21.598780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcff1b6f744bdb8c7f047aba22c095, user_id=42d03abd29d3498b9ad0434dda27424f, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:21.600233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0283b2-92aa-43e1-982a-2299887aa006 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:21.612898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 596/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 08:59:21 2022] PUT /identity/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095/users/42d03abd29d3498b9ad0434dda27424f/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 08:59:23.585673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c971a-f1d2-435f-89de-3348f43974be None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:23.586209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c971a-f1d2-435f-89de-3348f43974be None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:23.586313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c971a-f1d2-435f-89de-3348f43974be None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:23.587655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 597/1193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 08:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 08:59:23.593067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:23.593453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:23.593631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:23.613815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 08:59:23.615023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 08:59:23.679915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 597/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 08:59:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 08:59:23.704314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c971a-f1d2-435f-89de-3348f43974be None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:23.772678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:23.803634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c971a-f1d2-435f-89de-3348f43974be None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:23.836881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:23.837608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:23.837893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:23.838168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:23.847927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 08:59:23.855662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 08:59:23.856770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 08:59:23.857812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 598/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 08:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 08:59:23.862919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:23.939659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:23.965389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5a4c9-8b14-490e-aa9a-47010b700e89 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:24.001429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:24.002095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:24.002383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:24.002663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:24.003415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:24.003729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:24.005719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:24.013626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 598/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 08:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:24.019381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:24.116325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e97d9-8d51-422d-ac5b-92b80ffc94da None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:24.143409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:24.149405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:24.150255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:24.150537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:24.150817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] PATH_INFO: `/v3/users/42d03abd29d3498b9ad0434dda27424f` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:24.152005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] RBAC: Authorizing `identity:get_user(user_id=42d03abd29d3498b9ad0434dda27424f)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:24.153419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:24.155012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 599/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 23 08:59:24 2022] GET /identity/v3/users/42d03abd29d3498b9ad0434dda27424f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:24.160601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:24.260333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad10-5bc0-4ee5-bc17-1d6410f6f468 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:24.296453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:24.297090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:24.297377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:24.297656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:24.306447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:24.362967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:24.364964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:24.467859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 599/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 08:59:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 08:59:24.474493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:24.584338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ab1d-b450-42f4-b777-9a414a7877e7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:24.625546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:24.626424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:24.626712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:24.626991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] PATH_INFO: `/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:24.628236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] RBAC: Authorizing `identity:get_project(project_id=5bdcff1b6f744bdb8c7f047aba22c095)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:24.629709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205e62-92a7-4eed-8040-1b5a8214877b None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:24.635324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 600/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 23 08:59:24 2022] GET /identity/v3/projects/5bdcff1b6f744bdb8c7f047aba22c095 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:24.637947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 08:59:24.686541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:24.754367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e4c91-e7de-439b-8ebf-24b22323a92b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 08:59:24.794575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 08:59:24.795230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 08:59:24.795516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 08:59:24.795795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 08:59:24.796665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=5bdcff1b6f744bdb8c7f047aba22c095, user.id=42d03abd29d3498b9ad0434dda27424f) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 08:59:24.796981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 08:59:24.798409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6a43-a667-4604-b29f-73bdef9bca60 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 08:59:24.804160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 600/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 08:59:24 2022] GET /identity/v3/role_assignments?user.id=42d03abd29d3498b9ad0434dda27424f&scope.project.id=5bdcff1b6f744bdb8c7f047aba22c095&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 08:59:34.621442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=67 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 08:59:34.801554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=49 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:20.051917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587925a-c699-4013-92ed-9f006518158e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:20.052561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587925a-c699-4013-92ed-9f006518158e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:20.052561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587925a-c699-4013-92ed-9f006518158e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:20.055559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 601/1201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:20.059788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:20.060281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:20.060512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:20.084949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:20.088592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:20.181143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 601/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:20.214646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587925a-c699-4013-92ed-9f006518158e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:20.351529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587925a-c699-4013-92ed-9f006518158e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:20.403331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:20.404318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:20.404746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:20.405192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:20.420710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:20.422383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:20.446737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:20.447904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:20.448952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:20.448952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:20.448952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:20.448952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:20.448952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 602/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:20.454186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:20.595053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec534f8-febd-43c9-ae7e-bc7c4c9e6bd8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:20.639027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:20.647031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:20.647833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:20.648171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:20.648491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:20.649338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:20.650220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:20.651812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8411-cb5a-4be8-bca1-22b5fd6967b6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:20.665957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 602/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:20.671908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:20.735023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:20.802947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7507f-1869-4486-84e1-0d40a4e409de None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:20.846334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:20.848025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:20.848555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:20.849059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:20.850053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:20.851695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726e369-55eb-43b4-89b1-761c76dac498 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:20.880400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 603/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 23 09:00:20 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:00:23.114366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a77eb-6b35-4784-8977-6a3e72ad0c16 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:23.114922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a77eb-6b35-4784-8977-6a3e72ad0c16 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:23.114922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a77eb-6b35-4784-8977-6a3e72ad0c16 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:23.116289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 603/1206] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:23.122184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:23.122656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:23.122932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:23.141164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:23.142370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:23.224000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 604/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:23.249107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a77eb-6b35-4784-8977-6a3e72ad0c16 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:23.371836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a77eb-6b35-4784-8977-6a3e72ad0c16 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:23.408504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:23.410116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:23.410409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:23.410688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:23.423005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:23.430897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:23.432196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:23.433160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 604/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 09:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:23.438437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:23.486043 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:23.560373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b907-d11b-473e-9670-1ab1de4cd556 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:23.603019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:23.604250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:23.604821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:23.605300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:23.606369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:23.606770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:23.608778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:23.620832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 605/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 09:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:23.626664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:23.692024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:23.756777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313751-90b7-4407-83d5-ad82575cc175 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:23.795863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:23.796796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:23.797121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:23.797472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:23.812868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:23.814405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:23.837916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:23.839175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:23.840269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:23.840269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:23.840269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:23.840269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:23.840269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 605/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:23.844961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:23.970151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:23.974293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7819-14d1-47e1-bf81-b15dc3cf96d0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:24.017724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:24.018484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:24.018793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:24.019146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:24.019970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:24.020317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:24.021689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:24.040629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 606/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:24.041814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:24.157233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1a49a-38dc-45de-82d5-a62d778f241f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:24.159897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:24.197803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:24.198606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:24.198890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:24.199162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:24.208569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:24.210043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:24.226135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:24.227224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:24.228285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 606/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 09:00:24.233115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:24.371763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602099a-7b6d-48c3-bedc-49e4d8de5ebd None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:24.423601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:24.424770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:24.425781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:24.426260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:24.427142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:24.427474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:24.429300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:24.451763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 607/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:24.457612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:24.592967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e78a-af64-4d41-9f08-f859e4ff5f01 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:24.639598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:24.640308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:24.640601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:24.640883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:24.674009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:24.728535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:24.730133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:24.851771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 607/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 09:00:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 09:00:24.858519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:24.887658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:24.996561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21914b43-6a93-4e66-aed8-4e1c6a8c1a8a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:25.045234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:25.046123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:25.046422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:25.046705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:25.064668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:25.066364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:25.088773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:25.089803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:25.090796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:25.090796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:25.090796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:25.090796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:25.096385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:25.106097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 608/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 09:00:25.167153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:25.210886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113b5c-cced-43e1-8b6b-9deeab0f077a None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:25.250357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:25.251110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:25.251381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:25.251689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:25.252607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:25.253531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:25.255002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:25.267409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 608/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:25.273311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:25.357591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:25.395296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9bd42-cd6a-414b-97a2-9d318364a7a9 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:25.440891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:25.442641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:25.443025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:25.443311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:25.451310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:25.452791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:25.466786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:25.473289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:25.474429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 609/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:25.476576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:25.610972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fdbd-2227-499e-a911-145879b33192 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:25.635509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:25.651190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:25.652037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:25.652329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:25.652606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:25.653403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:25.653716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:25.655142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f2f84-92ad-4f2a-83e1-866f7590f353 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:25.672843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 609/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:25.674541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:25.804606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15544c68-d6b8-480d-bff3-2fa7c50cfa72 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:25.838516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:25.846376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:25.848003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:25.848293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:25.848728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:25.849727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=503e24d396e2421bb0df4392288ac658) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:25.850081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:25.852233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b624a2-22aa-4262-b276-2abc45e5dc13 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:25.859487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 610/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 09:00:25 2022] GET /identity/v3/role_assignments?user.id=503e24d396e2421bb0df4392288ac658&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:27.955760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b85-08f1-4e0a-ba43-055e0b0076ed None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:27.956332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b85-08f1-4e0a-ba43-055e0b0076ed None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:27.956332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd9b85-08f1-4e0a-ba43-055e0b0076ed None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:27.957982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 610/1220] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 09:00:27.964468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:27.964895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:27.965070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:27.981451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:27.982708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:28.052798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 611/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:28.078054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b85-08f1-4e0a-ba43-055e0b0076ed None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:28.185977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd9b85-08f1-4e0a-ba43-055e0b0076ed None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:28.223857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:28.224754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:28.225066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:28.225340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:28.235708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:28.243980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:28.245100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:28.246127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 611/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:28.252599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:28.364884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91450a-934e-41c2-a6c4-93a37856c5f1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:28.388145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:28.399701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:28.400410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:28.400696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:28.400974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:28.401730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:28.402044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:28.403409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:28.412025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 612/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:28.418099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:28.472271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:28.533713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2478f6-d6c1-434c-8a47-36b47177f465 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:28.571611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:28.572427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:28.572717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:28.572997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:28.584219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:28.585679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:28.604203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:28.605142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:28.606107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:28.606107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:28.606107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:28.606107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:28.606107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 612/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:28.611218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:28.723553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d58e7-5bb4-41e8-961f-b1275d7d9ee7 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:28.760167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:28.761940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:28.761940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:28.761940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:28.762595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:28.762993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:28.764723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:28.778997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 613/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:28.785201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:28.890567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:28.898713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35145da-4eb9-41a8-9810-1c5b67d1dbaf None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:28.934863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:28.935705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:28.936018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:28.936301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:28.946586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:28.948181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:28.965076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:28.966818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:28.968185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 613/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:28.972473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.025480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:29.082508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a00b2-a118-4a28-a230-dfbf5520a9f6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:29.119361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:29.120060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:29.120364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:29.120644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:29.121483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:29.121786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:29.123195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:29.145287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 614/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:29.151348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.262810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32edaf7-30cd-48d7-a1ec-2143f6dc1f00 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:29.298686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:29.299529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:29.300375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:29.300648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:29.312813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:29.314409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:29.335230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:29.336347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:29.337467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:29.337467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:29.337467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:29.337467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:29.337467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 614/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:29.342861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.452234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b0be9-662b-4beb-88e4-197941fdc3e6 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:29.454643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:29.490257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:29.490987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:29.491296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:29.491569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:29.492437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:29.492821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:29.494271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:29.507786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 615/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:29.513921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.524559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:29.634517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6700cf-9376-408e-892f-53950a197359 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:29.670027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:29.670879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:29.671242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:29.671521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:29.679249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:29.680847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:29.697799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:29.699006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:29.700572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 615/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:29.705335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.819389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0587a4-fdd5-41f9-926e-4d7bc45bcb8e None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:29.856564 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:29.857288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:29.857578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:29.857858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:29.858649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:29.858967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:29.860485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd4af1-8920-4592-b34e-62e5ac7db02c None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:29.874371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 616/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:29.880293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:29.950458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:29.987831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e2bf-3780-4355-bb91-eefa84db8694 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:30.025037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:30.026037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:30.026373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:30.026655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/503e24d396e2421bb0df4392288ac658/roles/194576b9361e47329a8c8682963953d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:30.043617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=503e24d396e2421bb0df4392288ac658, role_id=194576b9361e47329a8c8682963953d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:30.045283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb257e-4dda-4c4e-a434-c8640e761872 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:30.060126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 616/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 09:00:29 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/503e24d396e2421bb0df4392288ac658/roles/194576b9361e47329a8c8682963953d5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:00:32.148828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d598-6638-4595-848f-ce0d330b7f76 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.149363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d598-6638-4595-848f-ce0d330b7f76 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.149363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83d598-6638-4595-848f-ce0d330b7f76 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.150745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 617/1233] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:32.156119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.156607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.156883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.178643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:32.180201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:32.249871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 617/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:32.274906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d598-6638-4595-848f-ce0d330b7f76 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:32.301984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:32.395857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83d598-6638-4595-848f-ce0d330b7f76 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:32.437519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:32.438249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.438503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.438809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.449353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:32.457667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:32.459273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 09:00:32.460746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:32.463762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 618/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 23 09:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:32.465011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:32.524403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:32.585713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbecff-4167-4e0e-94eb-b504423f400c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:32.626536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:32.627285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.627500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.628303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.629053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:32.629385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:32.630755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:32.638896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 618/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 23 09:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:32.645517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:32.739151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:32.757699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b038-f6d1-4f51-a946-3a837d437e75 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:32.795829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:32.796676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.796963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.797238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.808858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:32.810514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:32.832730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:32.834666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:32.836161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:32.836161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:32.836161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:32.836161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:32.836161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 619/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:32.840108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:32.951270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757e21-3175-4816-ae0a-dd3f1836e0a7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:32.962134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:32.990824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:32.991410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:32.991694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:32.992021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:32.992732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:32.994611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:32.994611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:33.007315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 619/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:33.013389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:33.123379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866fd78-da9f-4204-8493-ee69710035b3 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:33.158584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:33.159385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:33.159671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:33.159948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:33.163004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:33.167896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:33.169509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:33.184644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:33.186058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:33.187569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 620/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:33.192649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:33.302848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8cabe-0d1c-48d5-a5d0-2a14320aba00 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:33.345333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:33.346209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:33.347163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:33.347530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:33.348486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:33.348853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:33.350519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:33.371800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 620/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:33.378517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:33.496817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b63a-b714-4976-b2ce-cfce9b54ed75 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:33.533004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:33.533665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:33.534497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:33.534866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:33.606006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:33.614339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:33.615899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:33.716712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 621/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 09:00:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 09:00:33.723408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:33.753228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:33.832912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21b75b-ffe2-445d-8080-1d13302db428 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:33.866758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:33.867470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:33.867752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:33.868052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:33.879061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:33.880536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:33.901672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:33.902683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:33.903778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:33.903778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:33.903778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:33.903778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:33.903778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 621/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:33.911659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:34.011021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:34.017882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e396957-027b-4915-8df2-38a694ac6fd0 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:34.061701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:34.062512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:34.062859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:34.063179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:34.063975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:34.064359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:34.066036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:34.078489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 622/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:34.084827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:34.171397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:34.195897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1fca7d-9057-4893-9cc3-05f67ac7c1c7 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:34.233797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:34.234810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:34.235101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:34.235382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:34.243613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:34.245438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:34.260912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:34.261982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:34.267573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 622/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:34.269766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:34.380594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956379-ee4b-4cba-9c59-a8a502c80f4a None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:34.417390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:34.418198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:34.418650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:34.418936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:34.419879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:34.420242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:34.422099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf35e6d-735f-4d40-8a15-ebea5e995d43 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:34.434844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 623/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:34.441895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:34.552050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a51c7-444e-4004-b260-415c4b7bfffd None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:34.586371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:34.587031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:34.587318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:34.587596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:34.588472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] RBAC: Adding query filter params (role.id=194576b9361e47329a8c8682963953d5, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=503e24d396e2421bb0df4392288ac658) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:34.588790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:34.590223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403cc9-4a19-4f45-a345-aa8fc2ef5a99 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:34.596666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 623/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 09:00:34 2022] GET /identity/v3/role_assignments?user.id=503e24d396e2421bb0df4392288ac658&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=194576b9361e47329a8c8682963953d5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:36.921749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3da0-3eda-41c2-a1c4-11da35758411 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:36.922269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3da0-3eda-41c2-a1c4-11da35758411 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:36.922269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3da0-3eda-41c2-a1c4-11da35758411 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:36.923594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 624/1247] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 09:00:36.929590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:36.930046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:36.930224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:36.936324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:36.951347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:36.952717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:37.027216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 624/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 09:00:37.051083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3da0-3eda-41c2-a1c4-11da35758411 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:37.071224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:37.177921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3da0-3eda-41c2-a1c4-11da35758411 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:37.217978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:37.218778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:37.219061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:37.219333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:37.231386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:37.240076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:37.241058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:37.241927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 625/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:37.247822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:37.359715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6be2d-6fd8-4c47-874d-55fc33afef81 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:37.398905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:37.404947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:37.405664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:37.405993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:37.406307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:37.407206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:37.407559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:37.409729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:37.418704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 625/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:37.424336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:37.513232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:37.542395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd73e-b286-4480-a001-667303d55e23 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:37.578765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:37.579583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:37.579870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:37.580180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:37.593853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:37.595450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:37.617942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:37.619109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:37.620052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:37.620052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:37.620052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:37.620052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:37.620052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 626/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:37.626534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:37.732302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f0fbf-255a-46ca-b07e-a0395bfc9920 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:37.769210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:37.769855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:37.770181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:37.770535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:37.771333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:37.771668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:37.773167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:37.787486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 626/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:37.793603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:37.907838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9451b64-1a61-4d22-a3dc-479baa92daea None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:37.935505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:37.946238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:37.947084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:37.947368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:37.947672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:37.955464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:37.958202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:37.973423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:37.974587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:37.975605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 627/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:37.980920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:38.043137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:38.090539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29809e3-508d-4f71-bf38-5c1b47796f61 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:38.124916 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:38.125588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:38.125879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:38.126162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:38.127003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:38.127321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:38.129320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:38.148282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 627/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:38.154021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:38.261731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa234c-6085-4c5e-a0f8-361f38bfe7bd None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:38.301253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:38.301823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:38.302109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:38.302386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:38.365333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:38.383798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:38.386108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:38.497681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 628/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 09:00:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 09:00:38.504232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:38.606889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fed5c-7351-4b39-adee-9eb65c9d3b81 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:38.621059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:38.644850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:38.645648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:38.645934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:38.646211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:38.657136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:38.658572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:38.676285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:38.677210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:38.678246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:38.678246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:38.678246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:38.678246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:38.678246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 628/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:38.683478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:38.778213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:38.791332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65642f5-4ea3-44b7-89ff-0327f41d7b32 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:38.827508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:38.828208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:38.828489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:38.828763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:38.829489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:38.829797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:38.831886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:38.845257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 629/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:38.853464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:38.962119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3831428-d705-4737-9ff5-4e5b16c1de20 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:38.999336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:39.000179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:39.000466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:39.000744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:39.008632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:39.010113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:39.030413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:39.031412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:39.032375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 629/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 09:00:39.038257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:39.151677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742a570-cfaa-44ff-93e0-24095c3e6cd4 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:39.186904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:39.187581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:39.187870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:39.188195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:39.189013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:39.189333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:39.190792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c79a1-33da-42d8-be18-d9d9423fefa2 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:39.204600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 630/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:39.211241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:39.238172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:39.315399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25643c89-5399-42ad-b28d-288b6aa12d9b None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:39.352917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:39.353562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:39.353823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:39.354143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:39.354987 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=503e24d396e2421bb0df4392288ac658) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:39.355292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:39.356894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a8da1-f21f-4bd1-834f-079f202ed1af None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:39.362932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 630/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 09:00:39 2022] GET /identity/v3/role_assignments?user.id=503e24d396e2421bb0df4392288ac658&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:41.373644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a10-d5c4-4050-b260-0022de668588 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:41.374235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a10-d5c4-4050-b260-0022de668588 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:41.374327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368a10-d5c4-4050-b260-0022de668588 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:41.375659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 631/1261] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:41.382440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:41.382889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:41.383006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:41.399380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:41.400604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:41.465008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 631/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 09:00:41.486762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65368a10-d5c4-4050-b260-0022de668588 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:41.497953 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:41.592628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65368a10-d5c4-4050-b260-0022de668588 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:41.625065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:41.625786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:41.626073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:41.626350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:41.636658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:41.644812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:41.645963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:41.647199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 632/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 09:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:41.652068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:41.669419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:41.746883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d25fa-897e-4cd6-8d59-2740a1265609 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:41.780146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:41.780806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:41.781088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:41.781361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:41.782102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:41.782409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:41.783789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:41.791853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 632/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 09:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:41.797423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:41.868618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:41.903226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59fdb4-760d-4e81-aaaf-c0e67dc6606d None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:41.935973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:41.936769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:41.937053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:41.937331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:41.948389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:41.949849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:41.966451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:41.967485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:41.968652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:41.968652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:41.968652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:41.968652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:41.968652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 633/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:41.973519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.053089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:42.072266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ac928-cb2e-43a4-8191-cf7de1dbf899 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.104269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.104911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.105191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.105465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.106180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:42.106487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.107829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.119586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 633/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:42.125103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.232373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f52af1-5859-4338-8754-a5a78cbfa8e8 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.251572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:42.265361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.266156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.266440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.266717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.273931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.275364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:42.289784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:42.290739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:42.291868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 634/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:42.296834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.404075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d909-5aa7-421b-8a08-d1a75daec4b6 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.437569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.438231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.438514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.438790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.439614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:42.439943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.441385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.449894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:42.459101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 634/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:42.464801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.563914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e3ae2-7e30-45e2-8d00-83e4c61ccd20 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.597112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.597915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.598201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.598481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.608948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.610379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:42.627020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:42.628093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:42.629382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:42.629382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:42.629382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:42.629382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:42.629382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 635/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:42.633833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.730437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cb0f-2da3-410b-8766-2446cdbcb23c None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.763009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.763659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.763972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.764259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.764984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:42.765299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.766665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.778140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 635/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:42.783507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:42.813914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:42.881171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d62d-241b-40e9-82c7-8658e7db76cf None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:42.913812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:42.914621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:42.914904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:42.915179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:42.921758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:42.923189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:42.937047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:42.938100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:42.939049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 636/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:42.944843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:43.001097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:43.042497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be159e-19d1-440c-a503-81241f54c02d None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:43.075095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:43.075739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:43.076057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:43.076342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:43.077134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:43.077449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:43.078869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23d05-9458-4605-a5b6-625a4bcb9bde None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:43.091062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 636/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:43.096833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:43.184582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:43.193907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433fb4d-f89c-4a40-8072-ac2584a82ade None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:43.225856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:43.226733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:43.227014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:43.227289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] PATH_INFO: `/v3/projects/942b1b6d34064b149c63afa240ed7640/users/503e24d396e2421bb0df4392288ac658/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:43.229221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=942b1b6d34064b149c63afa240ed7640, user_id=503e24d396e2421bb0df4392288ac658, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:43.230632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987c5a8-d09b-4264-a120-c783c3194e65 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:43.243085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 637/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 23 09:00:43 2022] PUT /identity/v3/projects/942b1b6d34064b149c63afa240ed7640/users/503e24d396e2421bb0df4392288ac658/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:00:45.240217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93047-fbd2-4f8f-964b-a38b4e4013de None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.240749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93047-fbd2-4f8f-964b-a38b4e4013de None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.240840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd93047-fbd2-4f8f-964b-a38b4e4013de None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.242146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 637/1274] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:45.247143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.247557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.247705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.264056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:45.265264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:45.329365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 638/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:45.358322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93047-fbd2-4f8f-964b-a38b4e4013de None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:45.460787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd93047-fbd2-4f8f-964b-a38b4e4013de None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:45.484933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:45.501666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:45.502494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.502782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.503059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.513012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 09:00:45.521276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:45.522411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:45.523494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 638/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 23 09:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:45.528576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:45.608420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:45.626524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e632-fa4d-4568-8a11-3eb5e7f497a5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:45.659676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:45.660371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.660659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.660941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.661684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:45.662004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:45.663365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:45.671182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 639/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 23 09:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:45.676803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:45.773596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6701e8-8bda-401a-9be4-a5ce2945ef61 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:45.805058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:45.805857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.806139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.806415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.818086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:45.819513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:45.836537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:45.837569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:45.838539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:45.838539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:45.838539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:45.838539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:45.838539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 639/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:45.843211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:45.941579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666615-0b6e-47c8-b3dd-dde225af0c37 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:45.974920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:45.975575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:45.975867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:45.976181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:45.976911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:45.977228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:45.978607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:45.990100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 640/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:45.995710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:46.026509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:46.093160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb28b-087c-41ae-9df2-8a8c54e1b689 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:46.124732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:46.125510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:46.125794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:46.126068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:46.134090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:46.135520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 09:00:46.150105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:46.151232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:46.152624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 640/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 09:00:46.156915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:46.160673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:46.252323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7da71-f621-4ceb-9312-2c40836e9476 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:46.284897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:46.285483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:46.285764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:46.286038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:46.286862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:46.287169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:46.288601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:46.305325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 641/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 23 09:00:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:46.310816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:46.403663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:46.413132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9dc7-065c-45c9-9fda-392fa765a05f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:46.445793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:46.446428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:46.446711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:46.446986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:46.510361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:46.511781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:46.595378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:46.606521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 641/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 23 09:00:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 09:00:46.612916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:46.671126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:46.709657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895c90-f50b-4188-90bc-ddc9b46d0963 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:46.742926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:46.743714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:46.744037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:46.744325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:46.754099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:46.755542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 09:00:46.772698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:46.773732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:46.774841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 09:00:46.774841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 09:00:46.774841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 09:00:46.774841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:46.774841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 642/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:46.779430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:46.876043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b66eb-7cc1-4949-a31c-0fb289107141 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:46.909675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:46.910324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:46.910608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:46.910883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:46.911629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:46.911936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:46.913319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:46.924197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 642/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 23 09:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:46.929600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:47.026666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16ff5-0806-47d5-aa60-baa009970160 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:47.041309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:47.060861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:47.061844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:47.062134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:47.062483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:47.070543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:47.072070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 09:00:47.086213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:47.087251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: ERROR keystone.server.flask.application Jun 23 09:00:47.088581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 643/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 23 09:00:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:47.093263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:47.141303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:47.193210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61281dee-cd54-4266-b89f-ff6e379631c2 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:47.225914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:47.226559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:47.226841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:47.227115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:47.227894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:47.228234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:47.229641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb769d9-d69e-4f7c-9322-38c60426461e None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:47.241108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 643/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 23 09:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:47.247190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:47.346940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b5f59-ab6f-4a71-8462-e7906ea77d23 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:47.380867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:47.381511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:47.381794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:47.382074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:47.382895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] RBAC: Adding query filter params (role.id=10bf172db47a4b9aa18be1ac67449fb2, scope.project.id=942b1b6d34064b149c63afa240ed7640, user.id=503e24d396e2421bb0df4392288ac658) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:47.383206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:47.384643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f90144-e6b5-464c-9826-9cd5929a05d8 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:47.390291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 644/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 23 09:00:47 2022] GET /identity/v3/role_assignments?user.id=503e24d396e2421bb0df4392288ac658&scope.project.id=942b1b6d34064b149c63afa240ed7640&role.id=10bf172db47a4b9aa18be1ac67449fb2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:49.404838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3adf-7993-4183-bc85-6ce5b4065ec6 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:49.405371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3adf-7993-4183-bc85-6ce5b4065ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:49.405371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c3adf-7993-4183-bc85-6ce5b4065ec6 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:49.406766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 644/1288] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:49.412091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:49.412487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:49.412650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:49.429533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:49.430699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:49.459374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:49.495630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 645/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:49.518372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c3adf-7993-4183-bc85-6ce5b4065ec6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:49.617507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c3adf-7993-4183-bc85-6ce5b4065ec6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:49.627697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:49.649963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:49.650749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:49.651033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:49.651307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:49.651975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:49.653332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:49.665419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:49.666641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:49.667539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 645/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 09:00:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:49.672409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:49.767795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8195c-e5fb-4d38-bea1-a8eda4260d16 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:49.800783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:49.801422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:49.801705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:49.801983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:49.802689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:49.802999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:49.804384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b474a-0704-4896-9437-2f3a68679b31 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:49.809254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 646/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 23 09:00:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:00:49.814667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:49.910976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55abcd-4862-4c74-9d2f-bc86bec59b1f None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:49.942584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:49.943167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:49.943452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:49.943729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] PATH_INFO: `/v3/services` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:49.944456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:49.944766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:49.946116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b88b2-02c7-4c28-a875-038eaf460d45 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:49.950385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 646/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 23 09:00:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:51.926727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303fde5-aa91-4a63-aba7-34c0580f5de4 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:51.927277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303fde5-aa91-4a63-aba7-34c0580f5de4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:51.927277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303fde5-aa91-4a63-aba7-34c0580f5de4 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:51.928639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 647/1293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:51.933751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ffef5-02d4-4352-8348-8a81e633a156 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:51.934187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ffef5-02d4-4352-8348-8a81e633a156 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:51.934364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ffef5-02d4-4352-8348-8a81e633a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:51.950799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bd0ffef5-02d4-4352-8348-8a81e633a156 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:51.952004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bd0ffef5-02d4-4352-8348-8a81e633a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:51.980444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:52.016566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 647/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:52.039556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303fde5-aa91-4a63-aba7-34c0580f5de4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:52.070822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:52.139681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303fde5-aa91-4a63-aba7-34c0580f5de4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:52.172796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:52.173442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:52.173724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:52.173999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:52.174739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:52.176134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fca851-f595-46f7-b3a1-f22b0bce79be None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:52.188664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 648/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 23 09:00:52 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:00:54.233936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365a00-db13-44f6-965a-41a809cb5ac1 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.234478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365a00-db13-44f6-965a-41a809cb5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.234478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365a00-db13-44f6-965a-41a809cb5ac1 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.235849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 648/1296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:54.240921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.241375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.241473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.258296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:54.259471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:54.329552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 649/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:54.356030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365a00-db13-44f6-965a-41a809cb5ac1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:54.462820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365a00-db13-44f6-965a-41a809cb5ac1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:54.496013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:54.496749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.497036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.497317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.497969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:54.499345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:54.511545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:54.512863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:54.514040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 649/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 09:00:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:54.518860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:54.536568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:54.616225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe3885-03a4-4e8a-a7bc-19b5797140ad None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:54.650168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:54.650828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.651116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.651399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.652141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:54.652479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:54.653835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:54.659127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 650/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 23 09:00:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:54.664909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:54.696762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:54.763660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205cdf-5921-40ad-b468-53f3bbb312e1 None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:54.795998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:54.796643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.796930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.797208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.797993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] RBAC: Adding query filter params (interface=public, service_id=8a4cef7b493b4011bca079fe22869a67, region_id=RegionOne) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:54.798307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:54.800283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5958ac-b97d-4e93-93f6-a6819b52ae63 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:54.805184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 650/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 23 09:00:54 2022] GET /identity/v3/endpoints?service_id=8a4cef7b493b4011bca079fe22869a67&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:54.810636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:54.888912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:54.906399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae15ee-5118-4a73-9172-722c8d90d080 None admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:54.939454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:54.940159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:54.940446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:54.940724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:54.941401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:54.943010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ac3ad-0d26-47fc-994a-293d40ea4d10 None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:54.949655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 651/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 23 09:00:54 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:00:56.930453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fafa-293b-4c5a-9a8e-243b7b50948a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:56.930958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fafa-293b-4c5a-9a8e-243b7b50948a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:56.930958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fafa-293b-4c5a-9a8e-243b7b50948a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:56.932309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 651/1302] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:00:56.937366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:56.937792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:56.937935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:56.954508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:00:56.956218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:00:57.021228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 652/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:00:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 09:00:57.043816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675fafa-293b-4c5a-9a8e-243b7b50948a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:57.136343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:57.143943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675fafa-293b-4c5a-9a8e-243b7b50948a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:57.177399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:57.178192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:57.178480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:57.178758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:57.179408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:57.180848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 09:00:57.193275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 09:00:57.194465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application with Lock( Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self._enter() Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application return self.creator() Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application created_value = creator( Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: ERROR keystone.server.flask.application Jun 23 09:00:57.195504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 652/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 23 09:00:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 09:00:57.201234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:57.275965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:00:57.298560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8317f04-9182-4314-80c8-eb2099405f0d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:57.332017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:57.332673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:57.333006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:57.333331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] PATH_INFO: `/v3/services` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:57.334134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:00:57.334516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:57.336149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8419d4-dfc8-47ef-bb4f-4691398c7b6a None admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:57.341434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 653/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 23 09:00:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:00:57.347150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:00:57.444619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667044-9eea-4f75-b778-b3f19ad079ab None admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:00:57.475979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:00:57.476635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:00:57.476922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:00:57.477199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:00:57.477936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:00:57.479353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1db2-cbc7-4706-a453-e7808fd30099 None admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:00:57.504173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 653/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 23 09:00:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:01:07.338403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=30 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:01:07.498618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:00.091342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863f80c-c2a8-4e71-81bc-13c244f3185f None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:00.091881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863f80c-c2a8-4e71-81bc-13c244f3185f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:00.091881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863f80c-c2a8-4e71-81bc-13c244f3185f None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:00.097263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 654/1307] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:00.098904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af458c-daee-43ad-806c-9cfdcf247294 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:00.099375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af458c-daee-43ad-806c-9cfdcf247294 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:00.099581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af458c-daee-43ad-806c-9cfdcf247294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:00.290623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c0af458c-daee-43ad-806c-9cfdcf247294 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:00.291838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c0af458c-daee-43ad-806c-9cfdcf247294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:00.477845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 654/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:00.533304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:00.533967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:00.534439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:00.536459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 655/1309] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jun 23 09:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:00.554698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3a1f-8cb0-42ac-949a-dc732626dcb4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:00.555151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3a1f-8cb0-42ac-949a-dc732626dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:00.555590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e3a1f-8cb0-42ac-949a-dc732626dcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:00.675729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7f7e3a1f-8cb0-42ac-949a-dc732626dcb4 None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:00.677209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7f7e3a1f-8cb0-42ac-949a-dc732626dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:00.703470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:00.775295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 655/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jun 23 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:00.784955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:00.786875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:00.940579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb02c4-820a-48e3-acc7-46b699b06b83 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:01.033447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:01.034380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:01.034839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:01.035271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:01.037289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:01.097826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:01.161542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:01.163219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb434bf-bae1-4cb5-86ce-1b5b463fa771 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:01.183907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 656/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:03.586268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:03.586847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:03.587102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:03.588726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 656/1312] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:03.594649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f3-6a44-439b-9266-db302ef36464 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:03.595151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f3-6a44-439b-9266-db302ef36464 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:03.595272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d7f3-6a44-439b-9266-db302ef36464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:03.680815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4885d7f3-6a44-439b-9266-db302ef36464 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:03.682049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4885d7f3-6a44-439b-9266-db302ef36464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:03.783127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 657/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:03.821285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:03.822812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:03.932117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3c627-c5fc-4928-bd20-ba4f95103a84 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:04.004512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:04.007699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:04.008569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:04.009087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:04.009537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:04.011185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:04.118242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:04.119675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08728-e769-454f-a9ce-d29b79bcbb0e service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:04.138953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 657/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:06.453830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:06.454393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:06.454495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:06.455817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 658/1315] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:06.461029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f08d2-533f-4d40-b051-ed9181c2697f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:06.461449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f08d2-533f-4d40-b051-ed9181c2697f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:06.461633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f08d2-533f-4d40-b051-ed9181c2697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:06.525319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-612f08d2-533f-4d40-b051-ed9181c2697f None None] MFA Rules not processed for user `3703f739dc7b4959a5520ab44eb6f0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:06.526527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-612f08d2-533f-4d40-b051-ed9181c2697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:06.577499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:06.622011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 658/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:06.661177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:06.662721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:06.672417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:06.764888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6928f-428e-4f5b-8aee-d264b4ea878d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:06.836214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:06.836852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:06.837135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:06.837412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:06.839022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:06.899904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:06.945469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:06.946895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ae42-8396-4169-94ea-49f91238498a service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:06.965268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 659/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:02:09.515718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292d4e-0f18-464d-96fb-8619072fbd4d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:09.516285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292d4e-0f18-464d-96fb-8619072fbd4d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:09.516285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a292d4e-0f18-464d-96fb-8619072fbd4d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:09.518366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 659/1318] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:09.523427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a0b3-2872-40ce-b42d-c52ed2e8e2eb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:09.523800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a0b3-2872-40ce-b42d-c52ed2e8e2eb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:09.524035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a0b3-2872-40ce-b42d-c52ed2e8e2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:09.587338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-98d3a0b3-2872-40ce-b42d-c52ed2e8e2eb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:09.588591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-98d3a0b3-2872-40ce-b42d-c52ed2e8e2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:09.686439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 660/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:09.742512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:09.742812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:09.743093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:09.744653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 660/1320] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jun 23 09:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:09.750522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ac0d-452b-4ec1-ab50-408d87e6f8d7 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:09.750811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ac0d-452b-4ec1-ab50-408d87e6f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:09.751588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ac0d-452b-4ec1-ab50-408d87e6f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:09.772271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:09.824353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1757ac0d-452b-4ec1-ab50-408d87e6f8d7 None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:09.825548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1757ac0d-452b-4ec1-ab50-408d87e6f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:09.898790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 661/1321] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jun 23 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:09.907923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:09.909488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:10.010596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a4f32-ad6c-47ab-92ad-a72c3cf0a190 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:10.082028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:10.082608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:10.082892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:10.083166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:10.084822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:10.092160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:10.190888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:10.192373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb294d-55ea-4fa4-bc11-82f38fca4c3c service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:10.209858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 661/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:13.322165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:13.322721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:13.322721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:13.324131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 662/1323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:13.329483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79286-cf7f-4d0b-806b-a5cfacf12920 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:13.329879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79286-cf7f-4d0b-806b-a5cfacf12920 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:13.330043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79286-cf7f-4d0b-806b-a5cfacf12920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:13.395765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-edf79286-cf7f-4d0b-806b-a5cfacf12920 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:13.397052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-edf79286-cf7f-4d0b-806b-a5cfacf12920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:13.454172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:13.498180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 662/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:13.535563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:13.537164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:13.659073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7e69-36af-4c56-aa38-28fea5fd9f75 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:13.671977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:13.743243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:13.743888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:13.744198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:13.744476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:13.746118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:13.853714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:13.855080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95835525-4e6b-4149-b722-760b09c157c6 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:13.873573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 663/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:15.975557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:15.976100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:15.976100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:15.977455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 663/1326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:15.982763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586591-05e6-4eaa-a699-7d788d030c00 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:15.983216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586591-05e6-4eaa-a699-7d788d030c00 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:15.983335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21586591-05e6-4eaa-a699-7d788d030c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:16.030875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:16.048880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-21586591-05e6-4eaa-a699-7d788d030c00 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:16.050092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-21586591-05e6-4eaa-a699-7d788d030c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:16.145584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 664/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:16.181502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:16.183040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:16.285514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e99e9-2c5c-4ed4-8871-d28c001c5b77 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:16.363970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:16.364667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:16.364956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:16.365237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:16.367008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:16.385257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:16.477432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:16.478873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fc70b-7cee-44ec-b2f3-55f3ff2d6ada service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:16.497186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 664/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:02:18.589570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:18.590035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:18.590130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:18.591528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 665/1329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:18.597240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4d6b-4f21-4af0-8931-29a988d272f0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:18.597744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4d6b-4f21-4af0-8931-29a988d272f0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:18.597830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4d6b-4f21-4af0-8931-29a988d272f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:18.666398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-877d4d6b-4f21-4af0-8931-29a988d272f0 None None] MFA Rules not processed for user `3703f739dc7b4959a5520ab44eb6f0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:18.667567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-877d4d6b-4f21-4af0-8931-29a988d272f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:18.733294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:18.771486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 665/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:02:18.809391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:18.810985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:18.914621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61a8f6-1afb-478b-b7da-33bdd6b38804 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:18.935392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:18.992508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:18.993164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:18.993444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:18.993722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:18.995351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:19.104220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:19.105652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe5b65-ad6b-4421-911d-6c022a400aff service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:19.125055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 666/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:21.418752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:21.419278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:21.419278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:21.420740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 666/1332] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:21.427215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff877-ab77-48f9-9282-fc51a16f6677 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:21.427633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff877-ab77-48f9-9282-fc51a16f6677 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:21.427774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcff877-ab77-48f9-9282-fc51a16f6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:21.488477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:21.491618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9bcff877-ab77-48f9-9282-fc51a16f6677 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:21.493286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9bcff877-ab77-48f9-9282-fc51a16f6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:21.586996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 667/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:21.622084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:21.623600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:21.725507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4c2ef-0c89-4a82-8988-25c170a61602 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:21.798136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:21.798783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:21.799066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:21.799341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:21.801019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:21.827538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:21.908854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:21.910432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8fbf-2e6a-4d35-8b65-360eda4b2600 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:21.928293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 667/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:24.031046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:24.031519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:24.031622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:24.033089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 668/1335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:24.038165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d65c-d03c-445c-b452-95c26b41f17c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:24.038623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d65c-d03c-445c-b452-95c26b41f17c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:24.038751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d65c-d03c-445c-b452-95c26b41f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:24.102869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-93a4d65c-d03c-445c-b452-95c26b41f17c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:24.104104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93a4d65c-d03c-445c-b452-95c26b41f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:24.177389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:24.207557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 668/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:24.246674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:24.248193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:24.365503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601306-fca7-4df0-8390-5e80aea2d6a2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:24.394767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:24.440096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:24.440743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:24.441022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:24.441293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:24.443194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:24.552960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:24.554392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67cd5e-468f-4100-a217-caa8195041eb service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:24.573550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 669/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:26.983268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:26.983755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:26.983755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:26.985252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 669/1338] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:26.990539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b771-36bf-431e-9822-5a3718b42a0d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:26.990955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b771-36bf-431e-9822-5a3718b42a0d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:26.991096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b771-36bf-431e-9822-5a3718b42a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:27.057199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ffe7b771-36bf-431e-9822-5a3718b42a0d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:27.058403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ffe7b771-36bf-431e-9822-5a3718b42a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:27.067573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:27.155164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 670/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:27.190448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:27.191980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:27.292046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e75e5-0a2e-4be2-b239-1242c99b5eff None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:27.367878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:27.368623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:27.368910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:27.369268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:27.371102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:27.407869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:27.479178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:27.480640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb90fbe-858e-4837-a9cd-1e9e0389d0aa service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:27.498683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 670/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:31.507385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:31.507939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:31.507939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:31.509379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 671/1341] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:31.514697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c242-3b5e-472f-991a-ad40239daa53 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:31.515097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c242-3b5e-472f-991a-ad40239daa53 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:31.515265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6c242-3b5e-472f-991a-ad40239daa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:31.592961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-03f6c242-3b5e-472f-991a-ad40239daa53 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:31.594865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-03f6c242-3b5e-472f-991a-ad40239daa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:31.686470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:31.700396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 671/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:02:31.738654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:31.740843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:31.837517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbed21-dd6d-4f73-8549-169e0171775c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:31.841328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:31.841980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:31.843790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:31.843790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:31.852056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:31.853482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49d867-0051-4528-9cb1-908871e90ece service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:31.863512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 672/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:34.477998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01676-209d-4245-add2-46fd065b4dcc None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:34.478506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01676-209d-4245-add2-46fd065b4dcc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:34.478506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01676-209d-4245-add2-46fd065b4dcc None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:34.479862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 672/1344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:34.485728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b615-74af-4758-8d92-0503a524a871 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:34.486144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b615-74af-4758-8d92-0503a524a871 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:34.486294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974b615-74af-4758-8d92-0503a524a871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:34.514335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5974b615-74af-4758-8d92-0503a524a871 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:34.515528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5974b615-74af-4758-8d92-0503a524a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:34.544289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:34.604005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 673/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:02:34.639231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01676-209d-4245-add2-46fd065b4dcc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:34.650348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01676-209d-4245-add2-46fd065b4dcc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:34.653890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:34.654564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:34.654837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:34.655117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:34.665739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:34.667221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d54b9-e2de-48e6-a687-f86e4b184a8c service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:34.678435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 673/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:38.679457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dca0-564b-44c8-b91d-78d12d9ab233 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:38.680014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dca0-564b-44c8-b91d-78d12d9ab233 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:38.680014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dca0-564b-44c8-b91d-78d12d9ab233 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:38.681382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 674/1347] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:38.686890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9b0d-5e6c-413a-8cb9-092c369bc89e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:38.687305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9b0d-5e6c-413a-8cb9-092c369bc89e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:38.687626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9b0d-5e6c-413a-8cb9-092c369bc89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:38.706239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8d5b9b0d-5e6c-413a-8cb9-092c369bc89e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:38.707493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8d5b9b0d-5e6c-413a-8cb9-092c369bc89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:38.715698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 674/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:38.753821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4dca0-564b-44c8-b91d-78d12d9ab233 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:38.764234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4dca0-564b-44c8-b91d-78d12d9ab233 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:38.767748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:38.769805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:38.769805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:38.769805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:38.778665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:38.780123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2181-ef66-4d8b-8181-88419dbbaf52 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:38.789499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 675/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:43.712472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102607-860e-49f6-9c99-e5572eb8642f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:43.712881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102607-860e-49f6-9c99-e5572eb8642f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:43.713133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc102607-860e-49f6-9c99-e5572eb8642f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:43.714760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 675/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:43.721155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba130d2-26b0-47e6-aa2c-f0355457c07d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:43.721901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba130d2-26b0-47e6-aa2c-f0355457c07d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:43.722344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba130d2-26b0-47e6-aa2c-f0355457c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:43.861889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2ba130d2-26b0-47e6-aa2c-f0355457c07d None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:43.863088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2ba130d2-26b0-47e6-aa2c-f0355457c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:43.944904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 676/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:02:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:48.186583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d360-cab8-4c4c-8175-bf123c0155e8 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:48.188108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d360-cab8-4c4c-8175-bf123c0155e8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:48.188709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d360-cab8-4c4c-8175-bf123c0155e8 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:48.190471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 676/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:02:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:48.195992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b2a6-94af-4fab-8d2c-34156fb38947 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:48.196830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b2a6-94af-4fab-8d2c-34156fb38947 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:48.197182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b2a6-94af-4fab-8d2c-34156fb38947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:48.215842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9300b2a6-94af-4fab-8d2c-34156fb38947 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:48.217178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9300b2a6-94af-4fab-8d2c-34156fb38947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:48.225890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 677/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:48.702004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=13 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:49.654691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dba7a-3095-479e-b61d-74db34e01d01 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:49.655332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dba7a-3095-479e-b61d-74db34e01d01 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:49.655942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dba7a-3095-479e-b61d-74db34e01d01 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:49.657954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 677/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:49.663212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69265b73-f617-4997-8355-d332a3417b28 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:49.663653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69265b73-f617-4997-8355-d332a3417b28 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:49.663779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69265b73-f617-4997-8355-d332a3417b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:49.682481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-69265b73-f617-4997-8355-d332a3417b28 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:49.683671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-69265b73-f617-4997-8355-d332a3417b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:49.692248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 678/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:02:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:02:53.279609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019067a-f22b-4c3f-9710-d671b501adad None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:53.280524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019067a-f22b-4c3f-9710-d671b501adad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:53.280960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019067a-f22b-4c3f-9710-d671b501adad None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:53.286506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 678/1356] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:53.289287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4af3-7bd9-4bfa-9752-0fc760e6ef32 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:53.290067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4af3-7bd9-4bfa-9752-0fc760e6ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:53.290499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e4af3-7bd9-4bfa-9752-0fc760e6ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:53.314737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-534e4af3-7bd9-4bfa-9752-0fc760e6ef32 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:53.317442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-534e4af3-7bd9-4bfa-9752-0fc760e6ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:53.326892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 679/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:02:53.382095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b80c-0d36-4a28-9172-091c290ff336 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:53.382387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b80c-0d36-4a28-9172-091c290ff336 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:53.382671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876b80c-0d36-4a28-9172-091c290ff336 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:53.384370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 679/1358] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 23 09:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:53.393412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e9e-16ae-4e0c-9da2-e56ea8181d85 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:53.393770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e9e-16ae-4e0c-9da2-e56ea8181d85 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:53.394152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007e9e-16ae-4e0c-9da2-e56ea8181d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:53.445451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:02:53.454653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6f007e9e-16ae-4e0c-9da2-e56ea8181d85 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:53.455883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6f007e9e-16ae-4e0c-9da2-e56ea8181d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:53.549643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 680/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 23 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:53.558045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b80c-0d36-4a28-9172-091c290ff336 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:53.573337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876b80c-0d36-4a28-9172-091c290ff336 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:53.579143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:53.579790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:53.580114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:53.580397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:53.589659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:53.592260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44837-269c-4e25-ad58-d955bc87d835 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:53.608145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 680/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:55.844287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69b31-e98d-4fe9-b805-ffb546c1383d None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:55.844793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69b31-e98d-4fe9-b805-ffb546c1383d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:55.844883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69b31-e98d-4fe9-b805-ffb546c1383d None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:55.846226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 681/1361] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:55.851348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aad9-6641-4661-ba01-b42936e1ec0c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:55.851759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aad9-6641-4661-ba01-b42936e1ec0c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:55.851925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3aad9-6641-4661-ba01-b42936e1ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:55.870743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d8c3aad9-6641-4661-ba01-b42936e1ec0c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:55.872005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d8c3aad9-6641-4661-ba01-b42936e1ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:55.881065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 681/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:55.924841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69b31-e98d-4fe9-b805-ffb546c1383d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:55.940065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69b31-e98d-4fe9-b805-ffb546c1383d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:55.945759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:55.946407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:55.946697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:55.946982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:55.955734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:55.957380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c835-363f-47c7-bbfa-f68edd3518c8 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:55.967675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 682/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:02:58.325464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3754ed-d8bb-40ab-a9b1-6fa09a4dcb81 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:58.325934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3754ed-d8bb-40ab-a9b1-6fa09a4dcb81 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:58.326032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3754ed-d8bb-40ab-a9b1-6fa09a4dcb81 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:58.327415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 682/1364] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:58.332791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1205d8-2abf-4282-b523-2a61214aa058 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:58.333588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1205d8-2abf-4282-b523-2a61214aa058 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:58.334450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1205d8-2abf-4282-b523-2a61214aa058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:58.353580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-de1205d8-2abf-4282-b523-2a61214aa058 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:58.354786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-de1205d8-2abf-4282-b523-2a61214aa058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:58.364234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 683/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:58.413325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deda06-9001-443f-bcc5-f219db42140d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:58.413532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deda06-9001-443f-bcc5-f219db42140d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:58.414022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deda06-9001-443f-bcc5-f219db42140d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:58.415582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 683/1366] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 23 09:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:02:58.421116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c77d9-d288-47c9-8d2c-f7a1d65e16c4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:58.422357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c77d9-d288-47c9-8d2c-f7a1d65e16c4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:58.422865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c77d9-d288-47c9-8d2c-f7a1d65e16c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:58.442523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e24c77d9-d288-47c9-8d2c-f7a1d65e16c4 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:02:58.444012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e24c77d9-d288-47c9-8d2c-f7a1d65e16c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:02:58.453220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 684/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 23 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:02:58.460988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deda06-9001-443f-bcc5-f219db42140d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:02:58.475084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deda06-9001-443f-bcc5-f219db42140d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:02:58.480450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:02:58.481088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:02:58.481376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:02:58.481655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:02:58.490312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:02:58.491887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303bea6-4751-4fd9-addb-fd1f9f8ded39 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:02:58.501734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 684/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:00.617533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb309fb-ac6e-4d02-aeee-d0ec98d24ce8 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:00.618063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb309fb-ac6e-4d02-aeee-d0ec98d24ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:00.618063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb309fb-ac6e-4d02-aeee-d0ec98d24ce8 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:00.619480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 685/1369] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:00.624866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f714-d399-483b-9143-294cf3a8b896 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:00.625656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f714-d399-483b-9143-294cf3a8b896 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:00.626109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f714-d399-483b-9143-294cf3a8b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:00.644704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-91d8f714-d399-483b-9143-294cf3a8b896 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:00.646118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-91d8f714-d399-483b-9143-294cf3a8b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:00.654323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 685/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:03:00.699915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb309fb-ac6e-4d02-aeee-d0ec98d24ce8 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:00.715994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb309fb-ac6e-4d02-aeee-d0ec98d24ce8 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:00.722514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:00.723367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:00.723825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:00.724289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:00.733424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:00.735348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2d307-6bfb-4758-a635-f79fb9393944 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:00.750948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 686/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:01.442884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10243d4-a766-4303-b020-4cd0b6427ce9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:01.443445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10243d4-a766-4303-b020-4cd0b6427ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:01.443729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10243d4-a766-4303-b020-4cd0b6427ce9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:01.445157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 686/1372] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:01.450491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32283f-da26-4963-a06d-17eaa6fa684e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:01.450786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32283f-da26-4963-a06d-17eaa6fa684e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:01.451068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32283f-da26-4963-a06d-17eaa6fa684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:01.469709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-bc32283f-da26-4963-a06d-17eaa6fa684e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:01.470910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bc32283f-da26-4963-a06d-17eaa6fa684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:01.479007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 687/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:01.823005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e5a-f296-4e6e-9508-fd3a769fbd4e None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:01.823005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e5a-f296-4e6e-9508-fd3a769fbd4e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:01.823005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e5a-f296-4e6e-9508-fd3a769fbd4e None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:01.825815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 687/1374] 10.222.0.43 () {54 vars in 963 bytes} [Thu Jun 23 09:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:01.830185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac370-4030-4a12-b64a-2c8318b1105e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:01.830185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac370-4030-4a12-b64a-2c8318b1105e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:01.830786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ac370-4030-4a12-b64a-2c8318b1105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:01.887860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7b8ac370-4030-4a12-b64a-2c8318b1105e None None] MFA Rules not processed for user `bb4b2c43c8b74a2287730da251220971`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:01.889207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7b8ac370-4030-4a12-b64a-2c8318b1105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:01.973527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 688/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Jun 23 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:01.981706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2e5a-f296-4e6e-9508-fd3a769fbd4e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:01.993719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2e5a-f296-4e6e-9508-fd3a769fbd4e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:01.997245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:01.997881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:01.998164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:01.998439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:02.008780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:02.010380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f87324-3dce-4ff0-af81-36969de4bc1a service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:02.021170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 688/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:02.840951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656b592-e428-432c-bbed-a00869db804a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:02.841392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656b592-e428-432c-bbed-a00869db804a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:02.841616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656b592-e428-432c-bbed-a00869db804a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:02.843420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 689/1377] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:02.848817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8246d-38e6-4719-ba67-b94f03dd044c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:02.849284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8246d-38e6-4719-ba67-b94f03dd044c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:02.849425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8246d-38e6-4719-ba67-b94f03dd044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:02.869362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3fa8246d-38e6-4719-ba67-b94f03dd044c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:02.870579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3fa8246d-38e6-4719-ba67-b94f03dd044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:02.883855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 689/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:02.928801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656b592-e428-432c-bbed-a00869db804a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:02.943566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656b592-e428-432c-bbed-a00869db804a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:02.948897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:02.949527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:02.949812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:02.950091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:02.958695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:02.960331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e68a30-4961-4bc3-83a1-36b84aaba439 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:02.964815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:03:02.972482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 690/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:05.028425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c198-009e-4e21-8686-b60fee0abf74 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:05.029359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c198-009e-4e21-8686-b60fee0abf74 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:05.029814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0c198-009e-4e21-8686-b60fee0abf74 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:05.032332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 690/1380] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:05.037986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392dee-5096-4e68-88eb-df20a6f52bd9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:05.038439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392dee-5096-4e68-88eb-df20a6f52bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:05.038556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4392dee-5096-4e68-88eb-df20a6f52bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:05.058801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e4392dee-5096-4e68-88eb-df20a6f52bd9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:05.060001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e4392dee-5096-4e68-88eb-df20a6f52bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:05.069001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 691/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:05.113725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c198-009e-4e21-8686-b60fee0abf74 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:05.128215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0c198-009e-4e21-8686-b60fee0abf74 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:05.133648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:05.134282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:05.134565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:05.134839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:05.143362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:05.144953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abffe2-b367-442b-947b-f9b9ddd412ce service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:05.154124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 691/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:07.227763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1053565-581e-4989-beb9-15b4e2ab9c1a None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:07.228243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1053565-581e-4989-beb9-15b4e2ab9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:07.228433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1053565-581e-4989-beb9-15b4e2ab9c1a None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:07.229897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 692/1383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 09:03:07.235014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fac4-1184-484c-8d70-6c7652c65062 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:07.235795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fac4-1184-484c-8d70-6c7652c65062 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:07.236116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695fac4-1184-484c-8d70-6c7652c65062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:07.253842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c695fac4-1184-484c-8d70-6c7652c65062 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:07.255035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c695fac4-1184-484c-8d70-6c7652c65062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:07.262858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 692/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:07.304682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1053565-581e-4989-beb9-15b4e2ab9c1a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:07.319553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1053565-581e-4989-beb9-15b4e2ab9c1a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:07.325053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:07.325768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:07.326148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:07.326510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:07.335407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:07.337007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0791-fcc6-4660-bcf8-ecc972c79edf service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:07.348255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 693/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:09.407403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb50b8-775a-4b53-b74a-37c8ede9bfae None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:09.408037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb50b8-775a-4b53-b74a-37c8ede9bfae None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:09.408037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb50b8-775a-4b53-b74a-37c8ede9bfae None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:09.409696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 693/1386] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:09.414599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf4ee-07df-43f8-87a8-9855b5b734c8 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:09.414599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf4ee-07df-43f8-87a8-9855b5b734c8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:09.415659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccf4ee-07df-43f8-87a8-9855b5b734c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:09.433553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-76ccf4ee-07df-43f8-87a8-9855b5b734c8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:09.434949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-76ccf4ee-07df-43f8-87a8-9855b5b734c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:09.460480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 694/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:09.488674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb50b8-775a-4b53-b74a-37c8ede9bfae None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:09.506026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb50b8-775a-4b53-b74a-37c8ede9bfae None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:09.511712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:09.512443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:09.512732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:09.513018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:09.521701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:09.523283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86a731-a682-4868-9f31-b50400dcfbcf service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:09.533543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 694/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:12.459582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faf306-0848-49c7-ab3d-472c384d6eaf None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:12.460136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faf306-0848-49c7-ab3d-472c384d6eaf None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:12.460255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64faf306-0848-49c7-ab3d-472c384d6eaf None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:12.461579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 695/1389] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:12.467092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17903c-81eb-4b1e-a51b-ffeb8e7d9b35 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:12.467573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17903c-81eb-4b1e-a51b-ffeb8e7d9b35 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:12.467726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17903c-81eb-4b1e-a51b-ffeb8e7d9b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:12.486387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bb17903c-81eb-4b1e-a51b-ffeb8e7d9b35 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:12.487651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bb17903c-81eb-4b1e-a51b-ffeb8e7d9b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:12.495793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 695/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:12.539688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faf306-0848-49c7-ab3d-472c384d6eaf None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:12.554809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64faf306-0848-49c7-ab3d-472c384d6eaf None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:12.560588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:12.561229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:12.561522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:12.561799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:12.571200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:12.572811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4e942-8a0e-48a7-99bc-4f80234274d7 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:12.582490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 696/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:14.726670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198766f-d9d9-4df6-b184-09b47bb5245b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:14.727491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198766f-d9d9-4df6-b184-09b47bb5245b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:14.727491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198766f-d9d9-4df6-b184-09b47bb5245b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:14.728966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 696/1392] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:14.734862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21043-63b8-4e09-85c5-29dc848890fa None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:14.735246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21043-63b8-4e09-85c5-29dc848890fa None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:14.735557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d21043-63b8-4e09-85c5-29dc848890fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:14.757247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-10d21043-63b8-4e09-85c5-29dc848890fa None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:14.758759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-10d21043-63b8-4e09-85c5-29dc848890fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:14.768519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 697/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:14.813961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198766f-d9d9-4df6-b184-09b47bb5245b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:14.829391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198766f-d9d9-4df6-b184-09b47bb5245b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:14.835077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:14.835749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:14.836078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:14.836373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:14.845858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:14.847453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6abec3-d78c-4b6d-8c80-feab0e101cc7 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:14.857548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 697/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:16.923376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779fdb-b798-41d4-9cac-5ffac3cda803 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:16.923884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779fdb-b798-41d4-9cac-5ffac3cda803 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:16.923884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf779fdb-b798-41d4-9cac-5ffac3cda803 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:16.925276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 698/1395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:16.930605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b831416-59db-41d3-ba81-c789a6b0a695 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:16.931411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b831416-59db-41d3-ba81-c789a6b0a695 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:16.931872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b831416-59db-41d3-ba81-c789a6b0a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:16.950936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2b831416-59db-41d3-ba81-c789a6b0a695 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:16.952188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2b831416-59db-41d3-ba81-c789a6b0a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:16.960473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 698/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:17.007717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779fdb-b798-41d4-9cac-5ffac3cda803 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:17.023020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf779fdb-b798-41d4-9cac-5ffac3cda803 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:17.029408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:17.030086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.030371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.030649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.041580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:17.043193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b46925-d476-46ab-9a4e-ae0400113211 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:17.053202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 699/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:17.170757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061e8-9cf6-4c37-9cbf-c9f9d7096c6f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.171160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061e8-9cf6-4c37-9cbf-c9f9d7096c6f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.172149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061e8-9cf6-4c37-9cbf-c9f9d7096c6f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.173741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 699/1398] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:17.179492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6f57-70d5-4ea5-a080-510b39edb2ba None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.179784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6f57-70d5-4ea5-a080-510b39edb2ba None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.180137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6f57-70d5-4ea5-a080-510b39edb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.199525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7a8f6f57-70d5-4ea5-a080-510b39edb2ba None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:17.200831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7a8f6f57-70d5-4ea5-a080-510b39edb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:17.209026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 700/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:17.267484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7307b2-787e-44d3-bd94-84ba93abbc2a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.267850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7307b2-787e-44d3-bd94-84ba93abbc2a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.268224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7307b2-787e-44d3-bd94-84ba93abbc2a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.269720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 700/1400] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jun 23 09:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:17.274743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bff2-95ce-47e9-81a3-6ad473fa0edb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.275045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bff2-95ce-47e9-81a3-6ad473fa0edb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.275332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82bff2-95ce-47e9-81a3-6ad473fa0edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.330129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8c82bff2-95ce-47e9-81a3-6ad473fa0edb None None] MFA Rules not processed for user `06721172c3954f708ed5cae461e62961`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:17.331917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8c82bff2-95ce-47e9-81a3-6ad473fa0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:17.396475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 701/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jun 23 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:17.403988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7307b2-787e-44d3-bd94-84ba93abbc2a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:17.415288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7307b2-787e-44d3-bd94-84ba93abbc2a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:17.418961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:17.419602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:17.419892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:17.420231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:17.430163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:17.431606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5abe3-cf57-4dce-83f3-a575537f693c service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:17.441260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 701/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:18.150825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a99-e8fa-4868-871b-1c5ad681eb13 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:18.151311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a99-e8fa-4868-871b-1c5ad681eb13 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:18.151560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a99-e8fa-4868-871b-1c5ad681eb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:18.202219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-148c0a99-e8fa-4868-871b-1c5ad681eb13 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:18.204063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-148c0a99-e8fa-4868-871b-1c5ad681eb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:18.242878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:03:18.267242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 702/1403] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:18.311121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16766-4ee6-40d9-bd88-8863f48a1634 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:18.311564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16766-4ee6-40d9-bd88-8863f48a1634 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:18.312398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e16766-4ee6-40d9-bd88-8863f48a1634 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:18.313880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 702/1404] 10.222.0.43 () {54 vars in 942 bytes} [Thu Jun 23 09:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:18.320684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbd94-0135-494b-a1d4-e7c33d4819db None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:18.321044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbd94-0135-494b-a1d4-e7c33d4819db None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:18.321392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbd94-0135-494b-a1d4-e7c33d4819db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:18.371644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-14cfbd94-0135-494b-a1d4-e7c33d4819db None None] MFA Rules not processed for user `6f5ec849ef0e431d8ad7e84c94fac8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:18.372879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-14cfbd94-0135-494b-a1d4-e7c33d4819db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:18.444562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 703/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Thu Jun 23 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:18.454029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e16766-4ee6-40d9-bd88-8863f48a1634 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:18.467175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e16766-4ee6-40d9-bd88-8863f48a1634 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:18.472186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:18.472829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:18.473121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:18.473403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:18.481312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:18.482889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de69c74-5244-4d46-8a8a-f97db921b2a9 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:18.491308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 703/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:03:19.124757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afaa4-5fb9-44b4-b71a-872cc1b93d08 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:19.125048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afaa4-5fb9-44b4-b71a-872cc1b93d08 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:19.125358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7afaa4-5fb9-44b4-b71a-872cc1b93d08 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:19.126771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 704/1407] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:19.132204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608893-d3f5-4034-9e88-01fac158ef8b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:19.132502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608893-d3f5-4034-9e88-01fac158ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:19.132785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608893-d3f5-4034-9e88-01fac158ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:19.138763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=67 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:03:19.152228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-78608893-d3f5-4034-9e88-01fac158ef8b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:19.153575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-78608893-d3f5-4034-9e88-01fac158ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:19.179976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 704/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:19.212177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7afaa4-5fb9-44b4-b71a-872cc1b93d08 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:19.227597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7afaa4-5fb9-44b4-b71a-872cc1b93d08 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:19.236907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:19.237579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:19.237866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:19.238145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:19.247171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:19.248809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5db798-1941-4960-87b2-209ee6d00cb6 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:19.258741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 705/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:29.146910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:03:29.254196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=59 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:03:40.428824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd8fd2-7641-4b01-b7e2-6bab773bdfe9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:40.429373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd8fd2-7641-4b01-b7e2-6bab773bdfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:40.429373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd8fd2-7641-4b01-b7e2-6bab773bdfe9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:40.430666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 705/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jun 23 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:40.435659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac350-c0d4-40f1-b8ce-c1a05263c14c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:40.436121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac350-c0d4-40f1-b8ce-c1a05263c14c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:40.436257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac350-c0d4-40f1-b8ce-c1a05263c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:40.454860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6b7ac350-c0d4-40f1-b8ce-c1a05263c14c None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:40.456143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6b7ac350-c0d4-40f1-b8ce-c1a05263c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:40.464635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 706/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 23 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:40.479345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87942f8-7982-4927-9b3b-fcff48b51000 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:40.479640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87942f8-7982-4927-9b3b-fcff48b51000 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:40.479928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87942f8-7982-4927-9b3b-fcff48b51000 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:40.481329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 706/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jun 23 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:40.485742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2247-4d49-4f1a-8858-34cb5f8f728a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:40.486032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2247-4d49-4f1a-8858-34cb5f8f728a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:40.486312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2247-4d49-4f1a-8858-34cb5f8f728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:40.504327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-be0f2247-4d49-4f1a-8858-34cb5f8f728a None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:40.505520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-be0f2247-4d49-4f1a-8858-34cb5f8f728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:40.514581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 707/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 23 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:42.971876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867aa6e-013d-4842-bbe7-b6a100f996f5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:42.972462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867aa6e-013d-4842-bbe7-b6a100f996f5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:42.972462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867aa6e-013d-4842-bbe7-b6a100f996f5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:42.973872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:42.979154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685d0-1e0c-4932-9eca-c485d9f6efe8 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:42.979569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685d0-1e0c-4932-9eca-c485d9f6efe8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:42.979717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3685d0-1e0c-4932-9eca-c485d9f6efe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:42.997802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5a3685d0-1e0c-4932-9eca-c485d9f6efe8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:42.998980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5a3685d0-1e0c-4932-9eca-c485d9f6efe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:43.006816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:43.050964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867aa6e-013d-4842-bbe7-b6a100f996f5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:43.066163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867aa6e-013d-4842-bbe7-b6a100f996f5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:43.071858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:43.072525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:43.072813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:43.073093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:43.081572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:43.083176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf38115-318f-4e92-be25-1945d3fcbe44 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:43.092446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 708/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:43.980993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6c5a-59a7-49a9-acfc-7e74e2566722 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:43.981517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6c5a-59a7-49a9-acfc-7e74e2566722 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:43.981517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6c5a-59a7-49a9-acfc-7e74e2566722 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:43.982856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:43.987817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0434-fdd7-4670-8308-e568a11bd2e3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:43.988277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0434-fdd7-4670-8308-e568a11bd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:43.988439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0434-fdd7-4670-8308-e568a11bd2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:44.006201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41ab0434-fdd7-4670-8308-e568a11bd2e3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:44.007384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41ab0434-fdd7-4670-8308-e568a11bd2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:44.015019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:44.163478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b6c5a-59a7-49a9-acfc-7e74e2566722 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:44.178067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b6c5a-59a7-49a9-acfc-7e74e2566722 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:44.183340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:44.184200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:44.184482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:44.184757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:44.193245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:44.195119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1bb90-586d-48f9-8b2c-7ffb871beed9 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:44.204322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 710/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:45.085400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a7af-7e33-468d-97db-9e5a7394c3fd None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:45.085827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a7af-7e33-468d-97db-9e5a7394c3fd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:45.085968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692a7af-7e33-468d-97db-9e5a7394c3fd None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:45.087357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:45.092263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa41bb-b66e-413d-aa39-60925c0e8c4a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:45.092717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa41bb-b66e-413d-aa39-60925c0e8c4a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:45.092816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa41bb-b66e-413d-aa39-60925c0e8c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:45.110688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9afa41bb-b66e-413d-aa39-60925c0e8c4a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:45.111887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9afa41bb-b66e-413d-aa39-60925c0e8c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:45.119637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:45.270104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692a7af-7e33-468d-97db-9e5a7394c3fd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:45.284039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692a7af-7e33-468d-97db-9e5a7394c3fd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:45.289316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:45.289942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:45.290225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:45.290501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:45.298457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:45.300059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bcb4a-24cd-4121-8006-9a953a56094f service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:45.309461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 711/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:46.181865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61be0d-bea2-42eb-85e5-cfab693f3a74 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:46.182412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61be0d-bea2-42eb-85e5-cfab693f3a74 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:46.182412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61be0d-bea2-42eb-85e5-cfab693f3a74 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:46.183824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:46.189596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf61ae7-db17-4257-be7f-657790fb7a28 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:46.190013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf61ae7-db17-4257-be7f-657790fb7a28 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:46.190154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf61ae7-db17-4257-be7f-657790fb7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:46.208291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5bf61ae7-db17-4257-be7f-657790fb7a28 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:46.209486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5bf61ae7-db17-4257-be7f-657790fb7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:46.217344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:46.365234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61be0d-bea2-42eb-85e5-cfab693f3a74 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:46.379937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61be0d-bea2-42eb-85e5-cfab693f3a74 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:46.385631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:46.386269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:46.386555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:46.386862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:46.395261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:46.396881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167e782-1289-4bd3-9d69-6b258505a1d3 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:46.406166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 713/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:47.260064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8a1c-a357-401b-8ebf-c5617cd08703 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:47.260630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8a1c-a357-401b-8ebf-c5617cd08703 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:47.260630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f8a1c-a357-401b-8ebf-c5617cd08703 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:47.262062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:47.267544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0250-f7a4-4956-bf79-79b5e48712eb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:47.267993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0250-f7a4-4956-bf79-79b5e48712eb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:47.268119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0250-f7a4-4956-bf79-79b5e48712eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:47.286165 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e48e0250-f7a4-4956-bf79-79b5e48712eb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:47.287346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e48e0250-f7a4-4956-bf79-79b5e48712eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:47.295021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:47.444862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8a1c-a357-401b-8ebf-c5617cd08703 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:47.458805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f8a1c-a357-401b-8ebf-c5617cd08703 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:47.464177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:47.464832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:47.465111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:47.465389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:47.473978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:47.475535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fc2c8-5163-4911-a0c2-cd5bb305c98c service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:47.485709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 714/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:48.303318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf7f4-63b9-4d70-b48b-4067c8805978 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:48.303836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf7f4-63b9-4d70-b48b-4067c8805978 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:48.303836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebf7f4-63b9-4d70-b48b-4067c8805978 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:48.305256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:48.310214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b0cc-9330-4ea2-a9b1-076540d5374d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:48.310615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b0cc-9330-4ea2-a9b1-076540d5374d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:48.310759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b0cc-9330-4ea2-a9b1-076540d5374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:48.329071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1a64b0cc-9330-4ea2-a9b1-076540d5374d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:48.330257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1a64b0cc-9330-4ea2-a9b1-076540d5374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:48.337933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:03:48.486491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf7f4-63b9-4d70-b48b-4067c8805978 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:48.500773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebf7f4-63b9-4d70-b48b-4067c8805978 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:48.506157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:48.506793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:48.507077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:48.507355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:48.515410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:48.517576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c70f-6b20-4c22-b40e-8590f096f2cb service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:48.527093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 716/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:49.319045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc8666-2dd5-4f51-b566-ab65d20d6854 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:49.319614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc8666-2dd5-4f51-b566-ab65d20d6854 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:49.319614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc8666-2dd5-4f51-b566-ab65d20d6854 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:49.321005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:49.325849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141ed-2fb2-42a5-8837-b6a2fdf12f1f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:49.326279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141ed-2fb2-42a5-8837-b6a2fdf12f1f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:49.326392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c141ed-2fb2-42a5-8837-b6a2fdf12f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:49.346102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-42c141ed-2fb2-42a5-8837-b6a2fdf12f1f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:49.347291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-42c141ed-2fb2-42a5-8837-b6a2fdf12f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:49.355233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:49.503945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc8666-2dd5-4f51-b566-ab65d20d6854 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:49.518357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc8666-2dd5-4f51-b566-ab65d20d6854 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:49.523580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:49.524245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:49.524529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:49.524807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:49.532725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:49.534323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedaca6-45f1-43af-b2f0-66468dcce2fb service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:49.543445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 717/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:50.350575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ebc6-059f-466c-b459-f5e4fbb5aa9b None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:50.351138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ebc6-059f-466c-b459-f5e4fbb5aa9b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:50.351243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ebc6-059f-466c-b459-f5e4fbb5aa9b None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:50.352740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:50.357803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527a19-4274-49f1-8fac-f1a2720afe74 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:50.358225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527a19-4274-49f1-8fac-f1a2720afe74 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:50.358368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527a19-4274-49f1-8fac-f1a2720afe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:50.376858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b4527a19-4274-49f1-8fac-f1a2720afe74 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:50.378068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b4527a19-4274-49f1-8fac-f1a2720afe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:50.385823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:50.539781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ebc6-059f-466c-b459-f5e4fbb5aa9b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:50.554594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ebc6-059f-466c-b459-f5e4fbb5aa9b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:50.560341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:50.560976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:50.561266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:50.561548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:50.569958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:50.571535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f1b9-9b20-426a-af15-3462c8775d03 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:50.581763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 719/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:51.389540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a2f6-2372-42a8-895c-8d3fb144f56b None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:51.390194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a2f6-2372-42a8-895c-8d3fb144f56b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:51.390194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a2f6-2372-42a8-895c-8d3fb144f56b None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:51.391516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:51.396409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c081d-1b1a-4c99-8afa-8ae7633fe4a0 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:51.396836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c081d-1b1a-4c99-8afa-8ae7633fe4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:51.396981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c081d-1b1a-4c99-8afa-8ae7633fe4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:51.414610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c90c081d-1b1a-4c99-8afa-8ae7633fe4a0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:51.415802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c90c081d-1b1a-4c99-8afa-8ae7633fe4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:51.424183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:51.575162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a2f6-2372-42a8-895c-8d3fb144f56b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:51.589578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a2f6-2372-42a8-895c-8d3fb144f56b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:51.595156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:51.595810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:51.596129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:51.596409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:51.604835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:51.606412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0700361-331a-44e8-885a-472bfb74994f service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:51.616275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 720/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:53.523687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:53.524285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:53.524285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:53.525696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:53.531062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeee27-1b3e-441b-a698-222ca8f455c8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:53.532011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeee27-1b3e-441b-a698-222ca8f455c8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:53.532165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeee27-1b3e-441b-a698-222ca8f455c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:53.550099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-affeee27-1b3e-441b-a698-222ca8f455c8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:53.551297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-affeee27-1b3e-441b-a698-222ca8f455c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:53.559063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:53.597680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:53.599364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:53.612236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe78353-0976-4b56-a110-b9ef6c253c32 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:53.615754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:53.616435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:53.616719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:53.617002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:53.625886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:53.627312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db937eef-ab9a-4bab-ab55-7cc14a77fd67 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:53.636705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 722/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:55.814803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829a94-7c32-4072-933b-b40a50f36ae7 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:55.815358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829a94-7c32-4072-933b-b40a50f36ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:55.815523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829a94-7c32-4072-933b-b40a50f36ae7 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:55.816973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:55.822484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a625c-45d9-4f4a-a786-5aa3ad51ef1b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:55.822923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a625c-45d9-4f4a-a786-5aa3ad51ef1b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:55.823035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a625c-45d9-4f4a-a786-5aa3ad51ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:55.841408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a46a625c-45d9-4f4a-a786-5aa3ad51ef1b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:55.842563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a46a625c-45d9-4f4a-a786-5aa3ad51ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:55.850504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:55.890279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829a94-7c32-4072-933b-b40a50f36ae7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:55.900902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829a94-7c32-4072-933b-b40a50f36ae7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:55.904352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:55.904988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:55.905272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:55.905549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:55.914607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:55.916100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce02df-90c2-4389-8685-b986400100ba service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:55.926020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 723/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:03:58.243403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bbfe-72b6-4ce8-b9a4-3e38d3dc9ec4 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:58.244019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bbfe-72b6-4ce8-b9a4-3e38d3dc9ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:58.244019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057bbfe-72b6-4ce8-b9a4-3e38d3dc9ec4 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:58.245387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:03:58.251329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3517-5044-46d7-ad2e-95b76672e91c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:58.251784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3517-5044-46d7-ad2e-95b76672e91c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:58.251889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb3517-5044-46d7-ad2e-95b76672e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:58.269321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-23bb3517-5044-46d7-ad2e-95b76672e91c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:03:58.270522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-23bb3517-5044-46d7-ad2e-95b76672e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:03:58.278338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:03:58.319276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057bbfe-72b6-4ce8-b9a4-3e38d3dc9ec4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:03:58.332352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057bbfe-72b6-4ce8-b9a4-3e38d3dc9ec4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:03:58.335768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:03:58.336437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:03:58.336719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:03:58.336990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:03:58.346305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:03:58.347715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45070e2-a61a-4106-b6c4-8b694fb2e1e6 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:03:58.357702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 725/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:00.502537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af89f2-8e64-409b-b4e1-2f5c29e24108 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:00.503053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af89f2-8e64-409b-b4e1-2f5c29e24108 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:00.503151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af89f2-8e64-409b-b4e1-2f5c29e24108 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:00.504529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:00.509616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335a0b-3a36-4938-ae46-f2a1645ec62d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:00.510010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335a0b-3a36-4938-ae46-f2a1645ec62d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:00.510180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335a0b-3a36-4938-ae46-f2a1645ec62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:00.527610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2c335a0b-3a36-4938-ae46-f2a1645ec62d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:00.528827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2c335a0b-3a36-4938-ae46-f2a1645ec62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:00.536597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:00.575449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af89f2-8e64-409b-b4e1-2f5c29e24108 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:00.586342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af89f2-8e64-409b-b4e1-2f5c29e24108 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:00.590212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:00.590707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:00.591013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:00.591296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:00.600652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:00.602093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6ff1f-8eb7-4495-b2ea-c0f17590d7fa service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:00.612168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 726/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:02.757265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47d27-fb41-424a-a789-3fb22f7e8dbd None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:02.757806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47d27-fb41-424a-a789-3fb22f7e8dbd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:02.757806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a47d27-fb41-424a-a789-3fb22f7e8dbd None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:02.759215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:02.764402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409038-3c93-4962-81ba-7cff3261063b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:02.764830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409038-3c93-4962-81ba-7cff3261063b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:02.764973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409038-3c93-4962-81ba-7cff3261063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:02.783524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-12409038-3c93-4962-81ba-7cff3261063b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:02.784773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-12409038-3c93-4962-81ba-7cff3261063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:02.792624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:02.830495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a47d27-fb41-424a-a789-3fb22f7e8dbd None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:02.841489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a47d27-fb41-424a-a789-3fb22f7e8dbd None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:02.845703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:02.846332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:02.846617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:02.846895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:02.856189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:02.857619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a041a7-cfde-4624-831e-c072a2b3ec19 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:02.867381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 728/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:05.052193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb0dc-4a8a-400d-bb23-508222ee9a56 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:05.052581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb0dc-4a8a-400d-bb23-508222ee9a56 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:05.052752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb0dc-4a8a-400d-bb23-508222ee9a56 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:05.055203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:05.060458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517fb5-d62f-4884-ba29-8fa86759d758 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:05.060936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517fb5-d62f-4884-ba29-8fa86759d758 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:05.061086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517fb5-d62f-4884-ba29-8fa86759d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:05.079624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4d517fb5-d62f-4884-ba29-8fa86759d758 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:05.080993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4d517fb5-d62f-4884-ba29-8fa86759d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:05.088829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:05.126362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb0dc-4a8a-400d-bb23-508222ee9a56 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:05.136891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb0dc-4a8a-400d-bb23-508222ee9a56 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:05.140945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:05.141564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:05.141850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:05.142129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:05.150979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:05.152488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613b113-3576-4117-bf62-8f9937bfd0ab service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:05.162654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 729/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:07.212219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576581-865c-4e58-af0d-b3e5f5b80517 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:07.212796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576581-865c-4e58-af0d-b3e5f5b80517 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:07.212796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5576581-865c-4e58-af0d-b3e5f5b80517 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:07.214171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:07.219817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ba0b-0d58-4000-9367-0af781145218 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:07.220265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ba0b-0d58-4000-9367-0af781145218 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:07.220477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ba0b-0d58-4000-9367-0af781145218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:07.238343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1f96ba0b-0d58-4000-9367-0af781145218 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:07.239544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1f96ba0b-0d58-4000-9367-0af781145218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:07.247276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:04:07.284965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5576581-865c-4e58-af0d-b3e5f5b80517 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:07.295679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5576581-865c-4e58-af0d-b3e5f5b80517 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:07.299363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:07.300029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:07.300318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:07.300597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:07.309727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:07.311148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24aecea-5637-4549-9243-a17affd2cfa9 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:07.320771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 731/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:09.376092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e34ef-0472-48ec-852a-f88ae6e8328d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:09.376649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e34ef-0472-48ec-852a-f88ae6e8328d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:09.376649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e34ef-0472-48ec-852a-f88ae6e8328d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:09.378005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:09.383100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bece1c-0768-4eab-a40a-1b5379813998 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:09.383507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bece1c-0768-4eab-a40a-1b5379813998 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:09.383655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bece1c-0768-4eab-a40a-1b5379813998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:09.389623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=79 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:04:09.403014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e7bece1c-0768-4eab-a40a-1b5379813998 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:09.404261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e7bece1c-0768-4eab-a40a-1b5379813998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:09.412178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:09.450078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e34ef-0472-48ec-852a-f88ae6e8328d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:09.455875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=73 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:04:09.462439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e34ef-0472-48ec-852a-f88ae6e8328d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:09.465954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:09.466595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:09.466881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:09.467158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:09.476161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:09.477586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac2bbb-f559-4f74-82a9-00b607126af9 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:09.487403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 732/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:11.514209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed85cd-46bd-4cf9-8350-486691cc6d43 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:11.514772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed85cd-46bd-4cf9-8350-486691cc6d43 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:11.514772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed85cd-46bd-4cf9-8350-486691cc6d43 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:11.516216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:11.521304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a9c7-3a98-4ac0-9084-7657cb270f4b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:11.521691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a9c7-3a98-4ac0-9084-7657cb270f4b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:11.521857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75a9c7-3a98-4ac0-9084-7657cb270f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:11.539614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7b75a9c7-3a98-4ac0-9084-7657cb270f4b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:11.540823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7b75a9c7-3a98-4ac0-9084-7657cb270f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:11.549067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:11.584968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed85cd-46bd-4cf9-8350-486691cc6d43 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:11.596278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed85cd-46bd-4cf9-8350-486691cc6d43 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:11.599814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:11.600479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:11.600768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:11.601050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:11.610163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:11.611582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c884d9-d6f2-49f9-a60a-4170f6d551ec service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:11.620995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 734/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:13.676903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e5490-ee14-43b6-86f7-3ecce7b1c62d None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:13.677434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e5490-ee14-43b6-86f7-3ecce7b1c62d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:13.677529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e5490-ee14-43b6-86f7-3ecce7b1c62d None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:13.678843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:13.684114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9db-228e-4e11-bed2-ec0606bbcc76 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:13.684530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9db-228e-4e11-bed2-ec0606bbcc76 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:13.684699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9db-228e-4e11-bed2-ec0606bbcc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:13.702756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5f3ea9db-228e-4e11-bed2-ec0606bbcc76 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:13.704016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5f3ea9db-228e-4e11-bed2-ec0606bbcc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:13.711820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:13.748532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e5490-ee14-43b6-86f7-3ecce7b1c62d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:13.759031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e5490-ee14-43b6-86f7-3ecce7b1c62d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:13.762559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:13.763190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:13.763473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:13.763751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:13.772478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:13.773889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773665-8bac-47f9-ae62-0b70c0230955 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:13.783656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 735/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:23.697857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=11 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:04:23.779030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=14 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:04:33.548616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e1ae-644d-470f-bae5-16396b0424a5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:33.549202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e1ae-644d-470f-bae5-16396b0424a5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:33.549202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e1ae-644d-470f-bae5-16396b0424a5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:33.550565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 736/1471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:33.556001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758568-69bf-4d9b-b605-065f41229ae8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:33.556473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758568-69bf-4d9b-b605-065f41229ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:33.556594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758568-69bf-4d9b-b605-065f41229ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:33.574239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2b758568-69bf-4d9b-b605-065f41229ae8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:33.575438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2b758568-69bf-4d9b-b605-065f41229ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:33.583743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 736/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:33.633482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c246-726c-41be-95e3-862955be681b None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:33.633774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c246-726c-41be-95e3-862955be681b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:33.634056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804c246-726c-41be-95e3-862955be681b None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:33.635461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 737/1473] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jun 23 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:33.641012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef86-dfc0-47d9-9268-af31a69d50c3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:33.641300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef86-dfc0-47d9-9268-af31a69d50c3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:33.641576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932ef86-dfc0-47d9-9268-af31a69d50c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:33.659785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8932ef86-dfc0-47d9-9268-af31a69d50c3 None None] MFA Rules not processed for user `06721172c3954f708ed5cae461e62961`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:33.661005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8932ef86-dfc0-47d9-9268-af31a69d50c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:33.667402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 737/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jun 23 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:33.674585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c246-726c-41be-95e3-862955be681b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:33.685617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804c246-726c-41be-95e3-862955be681b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:33.689145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:33.689774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:33.690064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:33.690353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:33.699544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:33.701001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f3568-7a3e-4e09-a3c2-cd2d407c33d8 service glance] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:33.711011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 738/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:04:35.811279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb02f-cf0e-41ab-96a5-663c7502dbce None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:35.811831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb02f-cf0e-41ab-96a5-663c7502dbce None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:35.811831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb02f-cf0e-41ab-96a5-663c7502dbce None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:35.813250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 738/1476] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:35.818260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34233-2778-4cad-9f83-a2731a068bb0 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:35.818679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34233-2778-4cad-9f83-a2731a068bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:35.818822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a34233-2778-4cad-9f83-a2731a068bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:35.837064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-53a34233-2778-4cad-9f83-a2731a068bb0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:35.838265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-53a34233-2778-4cad-9f83-a2731a068bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:35.846769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 739/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:35.869616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb02f-cf0e-41ab-96a5-663c7502dbce None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:35.881748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb02f-cf0e-41ab-96a5-663c7502dbce None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:35.886209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:35.886852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:35.887137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:35.887418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:35.888178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:35.890492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:04:35.890492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:04:35.890492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:04:35.891639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0145f-862e-4e5a-a26a-246aed114150 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:35.910781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 739/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 23 09:04:35 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:04:37.962158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b119d-3621-4393-a439-555c2af17ef3 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:37.962695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b119d-3621-4393-a439-555c2af17ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:37.962695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b119d-3621-4393-a439-555c2af17ef3 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:37.964030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 740/1479] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:37.969212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-6a56-4521-be74-7f39122a5940 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:37.969613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-6a56-4521-be74-7f39122a5940 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:37.969779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468675cf-6a56-4521-be74-7f39122a5940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:37.988032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-468675cf-6a56-4521-be74-7f39122a5940 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:37.989253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-468675cf-6a56-4521-be74-7f39122a5940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:37.997054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 740/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:38.039470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b119d-3621-4393-a439-555c2af17ef3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:38.054441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b119d-3621-4393-a439-555c2af17ef3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:38.059644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:38.060331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:38.060617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:38.060902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:38.069855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:38.071435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52d4ec-b470-4953-9a17-0eac055ae35c service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:38.081063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 741/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:40.264620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f612-6f21-4523-b416-8538b318a548 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:40.265174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f612-6f21-4523-b416-8538b318a548 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:40.265174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f612-6f21-4523-b416-8538b318a548 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:40.266595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 741/1482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:40.271632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9dc0-eff2-42d8-bc7b-d3d4bad7589b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:40.272051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9dc0-eff2-42d8-bc7b-d3d4bad7589b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:40.272221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd9dc0-eff2-42d8-bc7b-d3d4bad7589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:40.289449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9cdd9dc0-eff2-42d8-bc7b-d3d4bad7589b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:40.290621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9cdd9dc0-eff2-42d8-bc7b-d3d4bad7589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:40.298813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 742/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:40.335226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f612-6f21-4523-b416-8538b318a548 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:40.345596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f612-6f21-4523-b416-8538b318a548 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:40.349072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:40.349699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:40.349982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:40.350259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:40.359749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:40.361204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c3552-f8b2-417a-93a8-ad70d1aeb471 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:40.370508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 742/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:42.436855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3436-dc3c-47c4-ad51-f2be9742ad1e None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:42.437362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3436-dc3c-47c4-ad51-f2be9742ad1e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:42.437469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a3436-dc3c-47c4-ad51-f2be9742ad1e None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:42.438870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 743/1485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:42.444313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6495-18c4-4f24-96b7-97e15130eb4d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:42.444712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6495-18c4-4f24-96b7-97e15130eb4d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:42.444880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6495-18c4-4f24-96b7-97e15130eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:42.463010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4a5a6495-18c4-4f24-96b7-97e15130eb4d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:42.464256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4a5a6495-18c4-4f24-96b7-97e15130eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:42.474323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 743/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:42.511987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a3436-dc3c-47c4-ad51-f2be9742ad1e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:42.523117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a3436-dc3c-47c4-ad51-f2be9742ad1e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:42.526623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:42.527255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:42.527543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:42.527826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:42.537355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:42.538786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c39207-64c7-44b9-bfbd-92152fe9ec5a service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:42.548170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 744/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:44.663070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbef-b79f-49c5-b5a5-30fd2f254a48 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:44.663579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbef-b79f-49c5-b5a5-30fd2f254a48 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:44.663698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbef-b79f-49c5-b5a5-30fd2f254a48 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:44.665079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 744/1488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:44.670104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037331-f5cc-4573-9af8-58c8453fdb7f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:44.670553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037331-f5cc-4573-9af8-58c8453fdb7f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:44.670702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11037331-f5cc-4573-9af8-58c8453fdb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:44.688090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-11037331-f5cc-4573-9af8-58c8453fdb7f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:44.689292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-11037331-f5cc-4573-9af8-58c8453fdb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:44.697431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 745/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:44.737782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dbef-b79f-49c5-b5a5-30fd2f254a48 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:44.748190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dbef-b79f-49c5-b5a5-30fd2f254a48 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:44.751671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:44.752335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:44.752621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:44.752897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:44.761636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:44.763063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00366d80-960c-4853-b77c-fd482c37460f service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:44.773193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 745/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:04:46.999741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f07a7-1581-4a37-9bef-968dfb41ac3f None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:47.000309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f07a7-1581-4a37-9bef-968dfb41ac3f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:47.000420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f07a7-1581-4a37-9bef-968dfb41ac3f None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:47.001768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 746/1491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 23 09:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:04:47.007019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ecbc-ceda-4121-9115-c2f873caf483 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:47.007445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ecbc-ceda-4121-9115-c2f873caf483 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:47.007558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453ecbc-ceda-4121-9115-c2f873caf483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:47.027406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5453ecbc-ceda-4121-9115-c2f873caf483 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:04:47.028696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5453ecbc-ceda-4121-9115-c2f873caf483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:04:47.037651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 746/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 23 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:04:47.076152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f07a7-1581-4a37-9bef-968dfb41ac3f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:04:47.087640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f07a7-1581-4a37-9bef-968dfb41ac3f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:04:47.091259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:04:47.091937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:04:47.092337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:04:47.092619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:04:47.102897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:04:47.104540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac7671-2e76-44f1-ac4d-94e4c66f2e26 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:04:47.114113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 747/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:04:57.020649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=33 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:04:57.109856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=33 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:06:18.106419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.107024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.107024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.125142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:06:18.126328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:18.134057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 747/1494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:06:18.143612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.144093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.144206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.161721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:06:18.162908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:18.170688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 748/1495] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:06:18.175130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.185398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf8a63-2202-4955-9d7a-61e1295df758 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.189886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.190531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.190816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.191095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.191815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:06:18.192170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.193174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.193174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:06:18.193174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:06:18.194068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.206304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 748/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:06:18.214222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.223354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176ece1-0fe5-4834-bc48-c4b9afccb72d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.227911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.228589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.228876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.229348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.230060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.231844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.231844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:06:18.231844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:06:18.233071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.268924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 749/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:06:18.273287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.283234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dca5a-aed4-4942-8c5b-43bf6a839ccd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.338525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.339183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.339471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.339750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.340473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.341512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.341512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:06:18.341512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:06:18.342726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.362180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 749/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:06:18.366225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.377756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8823-edae-4b1a-b148-b31e89d27a0f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.382237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.382886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.383171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.383445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.384209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.385198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.385198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:06:18.385198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:06:18.386072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.398583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 750/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:06:18.402640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.412545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505c772-39ba-4a63-bd6c-759f3a20726b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.417134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.417790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.418080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.418363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.419666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.420734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.420734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:06:18.420734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:06:18.421628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020ca93-b451-4281-9a26-7ed555893bef admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.435200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 750/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:06:18.439099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.449142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf3be6-b890-4503-894d-dc50ff8f7214 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.453656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.454529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.454810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.455089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] PATH_INFO: `/v3/projects/8be527d0fc984284850ba31810e6e892/users/05d6b96a991c4929b077001086d77a48/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.469326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be527d0fc984284850ba31810e6e892, user_id=05d6b96a991c4929b077001086d77a48, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.470351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.470351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:06:18.470351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:06:18.472318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319806a1-9415-4475-be3f-d1c43bc36cce admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.485412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 751/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:06:18 2022] PUT /identity/v3/projects/8be527d0fc984284850ba31810e6e892/users/05d6b96a991c4929b077001086d77a48/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:06:18.496381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9091-dacd-4cc2-b156-779e7f773321 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.496682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9091-dacd-4cc2-b156-779e7f773321 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.496964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d9091-dacd-4cc2-b156-779e7f773321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.523357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-db1d9091-dacd-4cc2-b156-779e7f773321 None None] MFA Rules not processed for user `05d6b96a991c4929b077001086d77a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:06:18.524600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-db1d9091-dacd-4cc2-b156-779e7f773321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:18.588479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 751/1502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:06:18.601591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9b7e-cb29-4f27-8091-c1370cc59ef4 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.601885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9b7e-cb29-4f27-8091-c1370cc59ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.602164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9b7e-cb29-4f27-8091-c1370cc59ef4 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.603540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 752/1503] 10.222.0.43 () {54 vars in 963 bytes} [Thu Jun 23 09:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:06:18.608880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ea1e-70c4-4901-9d4a-2261633b2a1d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.609177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ea1e-70c4-4901-9d4a-2261633b2a1d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.609457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ea1e-70c4-4901-9d4a-2261633b2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.627787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4808ea1e-70c4-4901-9d4a-2261633b2a1d None None] MFA Rules not processed for user `bb4b2c43c8b74a2287730da251220971`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:06:18.628982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4808ea1e-70c4-4901-9d4a-2261633b2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:18.671562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:06:18.679845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 752/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:06:18.687934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9b7e-cb29-4f27-8091-c1370cc59ef4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.698661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9b7e-cb29-4f27-8091-c1370cc59ef4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.702104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.702732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.703014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.703289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.711294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.712738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.721750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 753/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:06:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:06:18.763117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d509bd-912e-43d4-8ac0-e69d64f98ae5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.763413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d509bd-912e-43d4-8ac0-e69d64f98ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.763699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d509bd-912e-43d4-8ac0-e69d64f98ae5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.765028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 753/1506] 10.222.0.43 () {52 vars in 829 bytes} [Thu Jun 23 09:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:06:18.768601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:18.829120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d88-94a5-43a3-877e-c919f58e1962 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:18.833595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:18.834455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.834738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.835013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] PATH_INFO: `/v3/users/05d6b96a991c4929b077001086d77a48` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.836213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d6b96a991c4929b077001086d77a48)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:18.837215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:18.837215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:06:18.837215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:06:18.838421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:18.909492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d6b96a991c4929b077001086d77a48'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:18.910184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d6b96a991c4929b077001086d77a48'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:18.923210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d6b96a991c4929b077001086d77a48'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:18.933116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d6b96a991c4929b077001086d77a48'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:18.933732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d6b96a991c4929b077001086d77a48'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:18.951702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:06:18.960699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 754/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:06:18 2022] DELETE /identity/v3/users/05d6b96a991c4929b077001086d77a48 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:06:18.965134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:18.965429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:18.965714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:18.983765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:06:18.985010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:19.041108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 754/1508] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:06:19.051793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:19.053207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:19.111552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffce0b-5bc7-47ed-b8e2-216b7a9c52d9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:19.115068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:19.115714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:19.116033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:19.116318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:19.125115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:19.126541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734359e7-9358-47ff-b69c-f3068d6eb6cb service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:19.135836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 755/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:06:19.453526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:06:19.454998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:06:19.467664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630200e-9a8a-4778-9ddd-a3b084826626 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:06:19.472792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:06:19.473725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:06:19.473953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:06:19.474276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] PATH_INFO: `/v3/projects/8be527d0fc984284850ba31810e6e892` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:06:19.475624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be527d0fc984284850ba31810e6e892)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:06:19.476705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:06:19.476705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:06:19.476705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:06:19.477924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:06:19.539479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be527d0fc984284850ba31810e6e892', 'request_id': 'req-75b9162f-de6c-4edd-b02d-f0d7e8348917'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:19.549355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be527d0fc984284850ba31810e6e892', 'request_id': 'req-75b9162f-de6c-4edd-b02d-f0d7e8348917'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:19.556035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be527d0fc984284850ba31810e6e892', 'request_id': 'req-75b9162f-de6c-4edd-b02d-f0d7e8348917'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:19.574663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] The token cache is being invalidate because project 8be527d0fc984284850ba31810e6e892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:06:19.574952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:19.576137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-75b9162f-de6c-4edd-b02d-f0d7e8348917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:06:19.577788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 755/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:06:19 2022] DELETE /identity/v3/projects/8be527d0fc984284850ba31810e6e892 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:06:29.131654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:06:29.571661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:08:03.824098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:03.824675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:03.824675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:03.826632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:03.831450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae3b73-b7f8-4d00-a484-cf0cb2861571 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:03.831897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae3b73-b7f8-4d00-a484-cf0cb2861571 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:03.832049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae3b73-b7f8-4d00-a484-cf0cb2861571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:03.850517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ffae3b73-b7f8-4d00-a484-cf0cb2861571 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:03.851669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ffae3b73-b7f8-4d00-a484-cf0cb2861571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:03.912277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:04.064755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:04.066422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:04.139594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151809f8-0bae-4063-bbd4-0ab8f959c16d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:04.144918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:04.145554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:04.145837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:04.146115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:04.154675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:04.156287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba898b-3d8d-4ee3-8ea0-a3d3b1c3e274 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:04.165432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 757/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:04.996707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dc7fc-0383-4f67-8bee-d7712cd8c557 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:04.997246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dc7fc-0383-4f67-8bee-d7712cd8c557 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:04.997246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dc7fc-0383-4f67-8bee-d7712cd8c557 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:04.999223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:05.004057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da673ca-82d7-4ce4-a0c1-ce6e2eebd180 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:05.004497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da673ca-82d7-4ce4-a0c1-ce6e2eebd180 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:05.004708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da673ca-82d7-4ce4-a0c1-ce6e2eebd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:05.022508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-0da673ca-82d7-4ce4-a0c1-ce6e2eebd180 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:05.023709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0da673ca-82d7-4ce4-a0c1-ce6e2eebd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:05.031514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:05.182859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dc7fc-0383-4f67-8bee-d7712cd8c557 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:05.197098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dc7fc-0383-4f67-8bee-d7712cd8c557 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:05.202449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:05.203077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:05.203365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:05.203639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:05.211621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:05.213245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2917ec-6036-4c98-bd55-154456c0b531 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:05.223022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 758/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:05.551484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ad3-e03d-492a-b470-104a76970bcb None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:05.551792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ad3-e03d-492a-b470-104a76970bcb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:05.552183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79455ad3-e03d-492a-b470-104a76970bcb None None] PATH_INFO: `/v3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:05.553558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 759/1517] 10.222.0.49 () {54 vars in 925 bytes} [Thu Jun 23 09:08:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:08:05.559812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2c6-a65b-4b77-a133-52b2219e4763 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:05.560148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2c6-a65b-4b77-a133-52b2219e4763 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:05.560428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1d2c6-a65b-4b77-a133-52b2219e4763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:05.578731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e4b1d2c6-a65b-4b77-a133-52b2219e4763 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:05.579925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e4b1d2c6-a65b-4b77-a133-52b2219e4763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:05.642095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 759/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jun 23 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:08:14.601741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed61f-946b-4c6d-9b1c-5a74ef6a802f None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:14.602168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed61f-946b-4c6d-9b1c-5a74ef6a802f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:14.602315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed61f-946b-4c6d-9b1c-5a74ef6a802f None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:14.603776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 760/1519] 10.222.0.43 () {54 vars in 960 bytes} [Thu Jun 23 09:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:14.608895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361887-a839-49b4-b257-4f3e886c3887 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:14.609333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361887-a839-49b4-b257-4f3e886c3887 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:14.609468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361887-a839-49b4-b257-4f3e886c3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:14.628823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-45361887-a839-49b4-b257-4f3e886c3887 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:14.630064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-45361887-a839-49b4-b257-4f3e886c3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:14.638533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 760/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Jun 23 09:08:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:14.646454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed61f-946b-4c6d-9b1c-5a74ef6a802f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:14.660390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed61f-946b-4c6d-9b1c-5a74ef6a802f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:14.665370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:14.666000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:14.666298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:14.666582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:14.675049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:14.676685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431a56e-3447-4273-a144-2ce237977ac7 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:14.686280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 761/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:16.446741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e672-7579-4a64-a7bb-fe1da445f497 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:16.447269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e672-7579-4a64-a7bb-fe1da445f497 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:16.447269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e672-7579-4a64-a7bb-fe1da445f497 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:16.448688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:16.454204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afedb7-990a-4b8f-bf8f-755cf8c40f40 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:16.454618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afedb7-990a-4b8f-bf8f-755cf8c40f40 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:16.454751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afedb7-990a-4b8f-bf8f-755cf8c40f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:16.472418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-61afedb7-990a-4b8f-bf8f-755cf8c40f40 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:16.473625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-61afedb7-990a-4b8f-bf8f-755cf8c40f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:16.481406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:16.633908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46e672-7579-4a64-a7bb-fe1da445f497 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:16.649021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46e672-7579-4a64-a7bb-fe1da445f497 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:16.654386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:16.655053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:16.655338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:16.655617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:16.663641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:16.665276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4c5b-2679-4a5a-a131-7ed75b3f66e1 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:16.674712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 762/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:17.490743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd468bf-17a4-4c3e-8206-f78f55a645bf None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:17.491334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd468bf-17a4-4c3e-8206-f78f55a645bf None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:17.491334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd468bf-17a4-4c3e-8206-f78f55a645bf None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:17.492726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 09:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:17.497438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5f62-6859-43ef-8c6f-f749c5cb4a32 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:17.497844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5f62-6859-43ef-8c6f-f749c5cb4a32 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:17.497995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5f62-6859-43ef-8c6f-f749c5cb4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:17.516097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0b5b5f62-6859-43ef-8c6f-f749c5cb4a32 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:17.517309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b5b5f62-6859-43ef-8c6f-f749c5cb4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:17.525156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 09:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:17.676585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd468bf-17a4-4c3e-8206-f78f55a645bf None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:17.690837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd468bf-17a4-4c3e-8206-f78f55a645bf None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:17.696563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:17.697217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:17.697491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:17.697777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:17.706376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:17.708251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66986ac-7d67-46a7-85af-f916bd6245a5 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:17.718310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 764/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:21.661875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:21.662467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:21.662467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:21.663815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:21.669352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fcb2-45a6-48d3-947c-231bdc62fe8e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:21.669759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fcb2-45a6-48d3-947c-231bdc62fe8e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:21.669914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fcb2-45a6-48d3-947c-231bdc62fe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:21.688612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d6a7fcb2-45a6-48d3-947c-231bdc62fe8e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:21.689814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d6a7fcb2-45a6-48d3-947c-231bdc62fe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:21.697736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:21.734810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:21.736558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:21.792898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1c588-fb53-4649-9bcb-834ca930d204 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:21.796449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:21.797087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:21.797372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:21.797732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:21.806324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:21.807749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c557c-8aee-4bdf-b77a-96aef5981dac service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:21.813170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:08:21.818031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 765/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:23.837674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1646bd-bf72-49d2-abfe-1cdd01ba3ef5 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:23.838227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1646bd-bf72-49d2-abfe-1cdd01ba3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:23.838350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1646bd-bf72-49d2-abfe-1cdd01ba3ef5 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:23.839740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:23.845050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb2f5-51aa-4f8f-8213-3faddcaca5b0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:23.845483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb2f5-51aa-4f8f-8213-3faddcaca5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:23.845619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb2f5-51aa-4f8f-8213-3faddcaca5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:23.863784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f7bfb2f5-51aa-4f8f-8213-3faddcaca5b0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:23.865013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f7bfb2f5-51aa-4f8f-8213-3faddcaca5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:23.873008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:23.908885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1646bd-bf72-49d2-abfe-1cdd01ba3ef5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:23.919483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1646bd-bf72-49d2-abfe-1cdd01ba3ef5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:23.923601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:23.924265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:23.924550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:23.924828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:23.933560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:23.934971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff345d-daa2-4a2a-ad33-5d8e52d7ea81 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:23.944353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 767/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:27.424570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:27.425201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:27.425201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:27.426430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:27.431602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf60d7-3ad2-4afc-9d78-19d2ae526e82 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:27.432032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf60d7-3ad2-4afc-9d78-19d2ae526e82 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:27.432203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf60d7-3ad2-4afc-9d78-19d2ae526e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:27.450124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7baf60d7-3ad2-4afc-9d78-19d2ae526e82 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:27.451845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7baf60d7-3ad2-4afc-9d78-19d2ae526e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:27.459608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:27.760410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:27.762072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:27.818782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbfaf0-a8af-41cc-af25-558786dfe5c9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:27.822513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:27.823145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:27.823428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:27.823705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:27.833239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:27.834664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73482a98-e0a0-48b9-b684-754d410100cd service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:27.844224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 768/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:29.881957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:29.882535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:29.882535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:29.883943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 09:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:08:29.889263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26752c07-e9c7-467d-a7cd-9e957c2039ca None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:29.889691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26752c07-e9c7-467d-a7cd-9e957c2039ca None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:29.889831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26752c07-e9c7-467d-a7cd-9e957c2039ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:29.910197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-26752c07-e9c7-467d-a7cd-9e957c2039ca None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:08:29.911418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-26752c07-e9c7-467d-a7cd-9e957c2039ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:29.920894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:08:30.225181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:08:30.226852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:08:30.234974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=65 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:08:30.241338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6dba-8d27-4f39-871a-22077a9035ff None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:08:30.244855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:08:30.245490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:08:30.245777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:08:30.246055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:08:30.254932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:08:30.256454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54004f-951b-4952-83c1-b6dc7b02963c service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:08:30.266288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 770/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:08:39.904740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=32 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:08:40.261606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:11.208462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.209126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.209126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.235401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.236682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.248473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 770/1540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.259385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f194-fc94-4c8b-b840-20be6ee3ab7c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.260009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f194-fc94-4c8b-b840-20be6ee3ab7c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.260009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618f194-fc94-4c8b-b840-20be6ee3ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.286084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7618f194-fc94-4c8b-b840-20be6ee3ab7c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.287351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7618f194-fc94-4c8b-b840-20be6ee3ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.304561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 771/1541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.309762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.321141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67b1d0-6e99-46d2-97e6-76e70c1cd1d8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.334270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.336810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.337374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.337496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637c97-787e-4a3f-952d-707c65cdb4bb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.337682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637c97-787e-4a3f-952d-707c65cdb4bb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.337956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637c97-787e-4a3f-952d-707c65cdb4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.338407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.339535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:11.340650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.342748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.361661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 771/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:11.369417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.373343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5a637c97-787e-4a3f-952d-707c65cdb4bb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.374581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5a637c97-787e-4a3f-952d-707c65cdb4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.384736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368d18-2a2f-41cd-aade-94ceaa3e5a20 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.394450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.395226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 772/1543] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:11.395753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.396347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.396625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98f70-f8e2-47cf-b612-e9f4bea21448 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.396918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98f70-f8e2-47cf-b612-e9f4bea21448 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.397204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98f70-f8e2-47cf-b612-e9f4bea21448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.397525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.398453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.400956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:11.400956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:10:11.400956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:10:11.403186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c67d-c5e9-484e-9128-afe525d6b440 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.433089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-84a98f70-f8e2-47cf-b612-e9f4bea21448 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.434889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-84a98f70-f8e2-47cf-b612-e9f4bea21448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.446727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 773/1544] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.451821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8377aa-7a69-4961-830d-6db19b6cf636 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.451821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8377aa-7a69-4961-830d-6db19b6cf636 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.451821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8377aa-7a69-4961-830d-6db19b6cf636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.459186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 772/1545] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:10:11.460805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a43-6bb6-49f7-94a6-616ffe26fe61 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.461316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a43-6bb6-49f7-94a6-616ffe26fe61 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.461800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a43-6bb6-49f7-94a6-616ffe26fe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.470586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fd8377aa-7a69-4961-830d-6db19b6cf636 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.472117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fd8377aa-7a69-4961-830d-6db19b6cf636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.501991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d1f55a43-6bb6-49f7-94a6-616ffe26fe61 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.503249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d1f55a43-6bb6-49f7-94a6-616ffe26fe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.545706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 774/1546] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.547063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.547359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.547641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.565195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.566435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.566754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 773/1547] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.568046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60809-f794-42a8-b664-3db4facfc47a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.568340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60809-f794-42a8-b664-3db4facfc47a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.568619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60809-f794-42a8-b664-3db4facfc47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.581120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 775/1548] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.582251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.593490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8c474-5c5d-4d86-858b-e7e1cf971381 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.594343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b6d60809-f794-42a8-b664-3db4facfc47a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.595650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b6d60809-f794-42a8-b664-3db4facfc47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.598312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.599015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.599301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.599581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.600325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.601343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:11.601343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:10:11.601343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:10:11.602571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951e1cb-8581-4d62-93c6-bff4dc349c61 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.606565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 774/1549] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.607825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117974a5-9627-44e8-832e-35ee7b00c52e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.608172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117974a5-9627-44e8-832e-35ee7b00c52e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.608454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117974a5-9627-44e8-832e-35ee7b00c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.622937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 776/1550] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:11.624058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.624356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.624644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.629710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-117974a5-9627-44e8-832e-35ee7b00c52e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.630918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-117974a5-9627-44e8-832e-35ee7b00c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.639315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 775/1551] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.640566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc28b-5061-4439-a335-8785540eaedd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.640858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc28b-5061-4439-a335-8785540eaedd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.641189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dc28b-5061-4439-a335-8785540eaedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.642478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.643667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.651828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 777/1552] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.653231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.662653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375be32-cac3-4e45-b2c5-18d0aa8be6c1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.664221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fe7dc28b-5061-4439-a335-8785540eaedd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.665590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fe7dc28b-5061-4439-a335-8785540eaedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.667284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.667993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.668281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.668559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.669294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:11.669604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.670611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:11.670611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:10:11.670611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:10:11.671498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25136d8b-54f7-4046-8d61-09b5070fd46a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.674190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 776/1553] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.675370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.675669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.676011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.685789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 778/1554] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:11.686957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.687254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.687538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.695566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.697082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.705865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 777/1555] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.706500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.709867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.711010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.716602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326de56c-77a4-4c62-af00-aa5767630623 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.720071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 779/1556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.720071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.724653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.725395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.725682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.725959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.726683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:11.726997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.728743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ee40-00ea-4b16-a964-d365c28a93a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.730289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc83b6-77e9-4ad2-b63b-3d55b0831d0d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.734639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.735275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.735558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.735839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.736604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.738164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1929068-5e6b-4e7e-901a-fb9f1a5ad51f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.740839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 778/1557] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:11.742140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725af9c-63e9-4c73-a4f1-499d1db5ec2b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.742441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725af9c-63e9-4c73-a4f1-499d1db5ec2b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.742726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725af9c-63e9-4c73-a4f1-499d1db5ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.748887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 780/1558] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:11.750107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.750399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.750677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.761221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e725af9c-63e9-4c73-a4f1-499d1db5ec2b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.762990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e725af9c-63e9-4c73-a4f1-499d1db5ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.768677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.769853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.770856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 779/1559] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.772064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.772349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.772623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.780750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 781/1560] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.781653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.792871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:11.793134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51166-0275-406d-86a8-f3823e16de32 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.794048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:11.797774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.798415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.798709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.798986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.799678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.801654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.802198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 780/1561] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:11.802964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.812064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159742ea-88ac-42cd-bea3-18ae46403038 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.816911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.817552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.817879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.818189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.819024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:11.819475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.821727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.829950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 782/1562] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:11.830849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.834615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 781/1563] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:11.835316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.845760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb1ab2-fbcf-4a38-adf7-a41226528ac6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.888573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:11.895898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:11.901045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50599843-02b4-467f-9405-2dbdc3fbbc03 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.906286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.906449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530375-d972-4853-8849-955536e026a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.906945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.907103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530375-d972-4853-8849-955536e026a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.907219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.907398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530375-d972-4853-8849-955536e026a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.907506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.907818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530375-d972-4853-8849-955536e026a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.908210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.908593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530375-d972-4853-8849-955536e026a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:11.908934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530375-d972-4853-8849-955536e026a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.910105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.910560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530375-d972-4853-8849-955536e026a7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.922377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 783/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:11.923194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530375-d972-4853-8849-955536e026a7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.939665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530375-d972-4853-8849-955536e026a7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:11.945239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 782/1565] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:11.945239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.945460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:11.945460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:11.945460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:11.945723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:11.946412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:11.948356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:11.963443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 784/1566] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:11.963443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:11.971075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f667f6f-a2dc-48b5-a392-a707c06328fb admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.006583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93021474-0ee3-44e7-a715-41ba235f3b41 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.012405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.013260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.013545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.013822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.014553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:12.014863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.016491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.029040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 783/1567] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:12.036185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.036287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.036287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.036287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.036287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.036615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:12.036615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.036615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.041853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853432b-04f1-485f-973f-f676f6611dae admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.046749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.047383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.047665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.047940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.048526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 785/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:12.048800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:12.049113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.049301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.050794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.059071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23209b-c141-4751-9fc7-05111c46636a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.063649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.064401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 784/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:12.064517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.064629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.064932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.065190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.065566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.067470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.077207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de3e54-4f11-49a7-b299-7e867292e40a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.083478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.084162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.084444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.084722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.086105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.088016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.088721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 786/1570] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.089520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.098996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f044e2-4a0c-4e98-93c6-7ec79e67a7ff admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.103606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.104283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.104574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.104859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.105586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.107647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.122577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 785/1571] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.123750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.139029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 787/1572] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.139910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.185048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10aab9-056a-4ed8-a9a7-c1a0d49d29aa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.202011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02747-38f0-43a4-b140-259152dd1048 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.206796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.207852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.208187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.208576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] PATH_INFO: `/v3/projects/db417a2b6b5c4bcd94d6bdb2b2b298cd/users/cc4f7b9f69ab47a39e1219a0605e7049/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.224173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db417a2b6b5c4bcd94d6bdb2b2b298cd, user_id=cc4f7b9f69ab47a39e1219a0605e7049, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.227840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.228629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:12.242205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 788/1573] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:12 2022] PUT /identity/v3/projects/db417a2b6b5c4bcd94d6bdb2b2b298cd/users/cc4f7b9f69ab47a39e1219a0605e7049/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:12.242899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.247245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.252942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.252942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.252942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.252942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.252942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.255587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:12.275652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 786/1574] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.275652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.283142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441747-7760-401d-a6f6-1f4dc4fcc6ad admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.307940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bdcbf-f018-4f20-be86-0739d49f007a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.313724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.314441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.314660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.314969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.315661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.317634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.338862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.339666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.340041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.340260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.340952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.342939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 789/1575] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.343529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.345938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.375663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 787/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.376835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.405423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01964b2-85a6-414e-8bdd-e590cc00a487 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.437613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53082-e3f2-49f8-84da-3701202ee783 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.442458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.443126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.443412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.443690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.444455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.446072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.456257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 788/1577] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.457112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.465943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.466608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.466785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d562-6cfe-44eb-9a62-f0f5999520dd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.466899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.467150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.467842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.469777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.471573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.472256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.472547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.472830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.473551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.475530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dcaad-b574-4e59-ae3d-35016e29a1e9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.496688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 790/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.500282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 789/1579] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.500423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.500508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.500508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.500508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.517773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:12.518997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:12.531106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:12.552360 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:12.567512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57432897-303b-4ac6-8845-fdc1beabd89e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.572371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.573041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.573325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.573600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.574289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.576205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.580307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 790/1580] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:12.581215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.591865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6029-ffb6-4e4d-8a22-59874ea85ec9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.596948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.597618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.598034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.598316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.599048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.600269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 791/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.600694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.601592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.613581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82852d-dba8-40a1-86cc-eddacde19e06 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.617121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 791/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.617121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.618594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.619259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.619547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.620072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.620775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.623275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.625102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6938c1-7b95-497c-aa65-3acd0e3b28af admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.629632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.630265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.630548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.630830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.631558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.633885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.644598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 792/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.645524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.658012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 792/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.658012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.658278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dbb64-8608-46c9-afee-cd1523ca096a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.661094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.661749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.662050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.662335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.663106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.664750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.665707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc284b3-bbc1-47fc-91f2-d68e1d046686 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.671655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.672385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.672667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.672955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.673657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.675555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.675936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 793/1585] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.679856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.690096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a8b8a-5ba4-4f3d-af2d-cd3e6d8b3e58 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.694739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.695393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.695507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 793/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:12 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:12.695687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.695998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.696478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.696761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.698832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.709896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 794/1587] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.710778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.720833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f5cb-1823-4cd8-8718-d6e816e4ee5a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.725436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.726137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.726360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.726643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.727361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.728961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.739724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 795/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.740598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.749773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe32829-bda5-46a8-9307-6293ad3b9bd8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.754337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.754955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.755238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.755514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.755626 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7ea4-e97c-4ca2-abe3-f7aad0bc175c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.756252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.757804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.759198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.759835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.760154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.760435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.770869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 796/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.770869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.771145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.771145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.779225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cfc62-7123-4561-8b0d-a241a2017340 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.781279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 794/1590] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:12.782089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.783926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.784584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.784865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.785137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.785859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.787419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.792008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8802b-63aa-472a-8837-d2c5e3d291ea service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.798197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.798499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 797/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.798856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.799164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.799348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.799467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.800297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.802279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.811478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76fb59-1a1f-474d-b181-e47f45c84b7b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.813755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 795/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.814664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.819297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.820294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.820648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.820998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] PATH_INFO: `/v3/projects/b9444918ee6e4df894784a29c5678f28/users/20a6d94b2d03465cb3e7619609084680/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.827577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e422fbc-8623-48c5-840a-024ed38d5d02 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.832422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.833139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.833442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.833705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.834463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.836080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.837559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9444918ee6e4df894784a29c5678f28, user_id=20a6d94b2d03465cb3e7619609084680, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.840832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.850639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 796/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.850639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.860150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 798/1594] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:12 2022] PUT /identity/v3/projects/b9444918ee6e4df894784a29c5678f28/users/20a6d94b2d03465cb3e7619609084680/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:12.861092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.865613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2efe0-9293-4ae2-bd40-f71dd27b99c9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.929672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ee82-3a1e-41d0-9839-138d714710e7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.933171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.934452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.935047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.935179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.935640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.935771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.936113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.936436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.937210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.937333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.938866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.939318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.950778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 799/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.951820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.958052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 797/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.958052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:12.968617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35c4a-2d51-4a11-beb9-f9814cd80006 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.971668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a2f30-31a7-4a01-9a94-7c3bc1e1473b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:12.974984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.976306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.976532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.976879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] PATH_INFO: `/v3/projects/68ace7ee10c54aff8992bcf6ce7dbf28/users/e60614620eb847f79fb6abbf33f47c2e/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.977472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:12.978135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:12.978483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:12.978769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:12.979637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.981901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.985006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:12.994919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ace7ee10c54aff8992bcf6ce7dbf28, user_id=e60614620eb847f79fb6abbf33f47c2e, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:12.997663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 798/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:12.997910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:12.999256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.001046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:13.010512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc6861-41ff-4c75-901b-10709d1c4ee7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.017462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 800/1598] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:12 2022] PUT /identity/v3/projects/68ace7ee10c54aff8992bcf6ce7dbf28/users/e60614620eb847f79fb6abbf33f47c2e/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.019388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.082788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.083466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.083752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.084050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.084891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.086732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00552c-9d9a-4a26-b29b-45d2ddaddfb6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.098280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfae971-21aa-4d5d-a01a-8a9a20d2ecee admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.098497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 799/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:13.100254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.100550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.100973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.106133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.107054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.107571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.107808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.108689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.110727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.123149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 801/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:13.124191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.132494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:13.133932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:13.134807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4b71-2571-489b-bb91-1eea881a664d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.140234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.141125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.141409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.141684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] PATH_INFO: `/v3/projects/07f8c4083f0d434dbdda1674fbe2cc07/users/92472668d49a4092b3c92bfce521189a/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.145217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 800/1601] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:13.146224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.158331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055aa4-0798-4cdf-88a7-7ec6626edafe None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.160597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f8c4083f0d434dbdda1674fbe2cc07, user_id=92472668d49a4092b3c92bfce521189a, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.163319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.164381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.165648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.166170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.166683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] PATH_INFO: `/v3/projects/2d8efe66a22b44c09e8f03759481943c/users/00fd84606a8e43fb814c68ccf1055338/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.177349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 802/1602] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:13 2022] PUT /identity/v3/projects/07f8c4083f0d434dbdda1674fbe2cc07/users/92472668d49a4092b3c92bfce521189a/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.178258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.189780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8efe66a22b44c09e8f03759481943c, user_id=00fd84606a8e43fb814c68ccf1055338, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.190936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:13.190936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:10:13.190936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:10:13.193008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59355-83d7-4766-94c8-ee527588e9ba admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.219773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 801/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:13 2022] PUT /identity/v3/projects/2d8efe66a22b44c09e8f03759481943c/users/00fd84606a8e43fb814c68ccf1055338/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.221666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.221962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.222246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.241469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:13.242605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:13.258633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0db-f689-462b-8556-fc4eadbb3caa admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.309785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 802/1604] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:13.314454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.326697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ded765-8a0e-4045-8eff-7809683d05c0 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.328076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.329496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.329931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.330358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] PATH_INFO: `/v3/projects/267cdc59ed8947b9a308684826284879/users/fbf3cd30ee4047cf93573e6d7926aeff/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.331633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.332568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.333025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.333308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] PATH_INFO: `/v3/projects/5d6b31bf3ac24b76a649aaa7183b0c37/users/5d9e82fb533f48e9882998804f1eaadd/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.347863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=267cdc59ed8947b9a308684826284879, user_id=fbf3cd30ee4047cf93573e6d7926aeff, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.350641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.351420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6b31bf3ac24b76a649aaa7183b0c37, user_id=5d9e82fb533f48e9882998804f1eaadd, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.354096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:13.354228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.368144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 803/1605] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:13 2022] PUT /identity/v3/projects/267cdc59ed8947b9a308684826284879/users/fbf3cd30ee4047cf93573e6d7926aeff/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.368820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 803/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:13 2022] PUT /identity/v3/projects/5d6b31bf3ac24b76a649aaa7183b0c37/users/5d9e82fb533f48e9882998804f1eaadd/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.369035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.369553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.421822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:13.435565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc114ec-711c-4a16-b436-6c33362f08e7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.439314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.439986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.440306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.440591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.442708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da053-16bc-4b4e-b216-83e3424be06e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.508143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.509720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6ff94-4eff-4da1-a922-de48fbb15512 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.518416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.519616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.519995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.520352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] PATH_INFO: `/v3/projects/69a9977bb52a434b844fef508dca3737/users/77ef8043cfee4a97bc6990264dbd7b00/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.536810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a9977bb52a434b844fef508dca3737, user_id=77ef8043cfee4a97bc6990264dbd7b00, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.537964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 804/1607] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:13.539532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.539844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f21361-3145-46cf-9404-5e78eb135f6e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.539989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.540334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.565142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 804/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:13 2022] PUT /identity/v3/projects/69a9977bb52a434b844fef508dca3737/users/77ef8043cfee4a97bc6990264dbd7b00/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:13.567200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f88f9-c647-4a7b-84df-7c1ff0b862a9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.567599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f88f9-c647-4a7b-84df-7c1ff0b862a9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.568024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f88f9-c647-4a7b-84df-7c1ff0b862a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.584879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] MFA Rules not processed for user `92472668d49a4092b3c92bfce521189a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:13.586573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:13.617318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ce9f88f9-c647-4a7b-84df-7c1ff0b862a9 None None] MFA Rules not processed for user `00fd84606a8e43fb814c68ccf1055338`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:13.618706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ce9f88f9-c647-4a7b-84df-7c1ff0b862a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:13.688723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 805/1609] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:13.689698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:13.713221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 805/1610] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:13.714740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a641-b021-4333-a5cc-5d8b1931cd15 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.715038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a641-b021-4333-a5cc-5d8b1931cd15 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.715321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761a641-b021-4333-a5cc-5d8b1931cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.798137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7761a641-b021-4333-a5cc-5d8b1931cd15 None None] MFA Rules not processed for user `5d9e82fb533f48e9882998804f1eaadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:13.801121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7761a641-b021-4333-a5cc-5d8b1931cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:13.808009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:13.820313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd94eb-00d5-4859-ac31-bc3cf2aef793 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:13.827478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:13.828231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.830026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.830149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.896236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:13.941077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 806/1611] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:13.942447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.942736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.943018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:13.957661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:13.959632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5796ab8-f698-46e6-8b8f-69a60fb97c6d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:13.978953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 806/1612] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:13.981568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:13.981929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:13.982200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.002210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:14.004037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:14.008997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] MFA Rules not processed for user `fbf3cd30ee4047cf93573e6d7926aeff`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:14.014002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:14.017054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 807/1613] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:14.018453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.044062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df9eb-b160-4174-bf31-5b2212c64c0d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.054833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.055648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.055939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.056257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.057372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.060118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92b6b9-04e7-4284-972c-558e840265c2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.113934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 808/1614] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:14.115293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eea68-743d-49f7-af6d-a8a6d427cd4a None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.118504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eea68-743d-49f7-af6d-a8a6d427cd4a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.120070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eea68-743d-49f7-af6d-a8a6d427cd4a None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.124108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 809/1615] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 23 09:10:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:14.125690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eea68-743d-49f7-af6d-a8a6d427cd4a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.175325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 807/1616] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:14.175325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.193039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb0c0-b414-4ef0-9712-658a28896eda None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.288262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eea68-743d-49f7-af6d-a8a6d427cd4a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.303269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.304142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.304432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.304711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.308110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.310390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.332833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.333556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.334060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.334344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.353238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 810/1617] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:14.358773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.362200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.366074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280ab01-6bf8-4de9-af5f-2ceab985cf4c service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.395536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 808/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:14.406177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.410451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.411395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.451859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:14.453149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:14.520033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee918d-e9bc-4668-840b-907b2726f996 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.542442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.546365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:14.547145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.547890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.548357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.550541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.557118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.602305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 811/1619] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:14.603573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.622871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73de882-4b46-4d25-b49b-604d8810bc83 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.629957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.630756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.631189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.632239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.633094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.635442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.664585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:14.695941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 812/1620] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:14.700694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.834260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da46158-2921-4116-bf55-3b970cf32fd0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.844330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 809/1621] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:14.848957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.850585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.851466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.851948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.853204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.853515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.857810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.880024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7b6ad-6473-4c90-be70-9573f13bb6d3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.885695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.886473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.887313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.887598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.888462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.890417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 813/1622] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:14.891674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.892030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:14.913682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0d605-4a48-476f-ba94-2a47f31ae86f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:14.914048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 810/1623] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:14.914939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:14.922336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:14.923093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:14.923422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:14.938664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:14.940803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:14.946151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.001570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 814/1624] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:14 2022] POST /identity/v3/users => generated 309 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:15.001570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.029669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ad69-fda9-463b-a019-7d6db192fa0a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.040218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.041719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.042015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.042300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.045522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.048465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.075755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d738-90cf-4b4f-a967-9fec0b38a733 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.077583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 815/1625] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:15.079901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.088339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.089742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.090341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.098603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.164357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e854f7-3b94-4213-8ee9-f68e612b0b19 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.164357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.164357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.164357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.165213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] PATH_INFO: `/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9/users/222809c593a24d84bc4c0a57d5c05306/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.175857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92f9bddefaa47a9a4f14c58854d99c9, user_id=222809c593a24d84bc4c0a57d5c05306, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.181873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.212126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 816/1626] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:15 2022] PUT /identity/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9/users/222809c593a24d84bc4c0a57d5c05306/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:15.212126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.279095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.283629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.312954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 811/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:15.313860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.339389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e291-4fc7-42ab-9d0e-f9c3c4e8e28b service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.391629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8ff5-536c-4247-8797-210fa916deb8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.408026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.408777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.409074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.409357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.410169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.411816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.415663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:15.430470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.431859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.432050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.432273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] PATH_INFO: `/v3/projects/3dcabdc2d3c844eb961a7a9edb119777/users/a9b615424c074405a31be39f624b7ecc/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.442592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 817/1628] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:15.442592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.453460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcabdc2d3c844eb961a7a9edb119777, user_id=a9b615424c074405a31be39f624b7ecc, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.456428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.464448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff5d92-de3e-4df8-b53b-736ebb2ff891 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.482220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.485340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.487059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.487528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 812/1629] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:15 2022] PUT /identity/v3/projects/3dcabdc2d3c844eb961a7a9edb119777/users/a9b615424c074405a31be39f624b7ecc/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:15.488444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.490749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.493733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.502441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.552341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 818/1630] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:15.557003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.620363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214c04f-0c3c-452d-87e2-bf0961a3ea72 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.632481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.633857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.634147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.634429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] PATH_INFO: `/v3/projects/88aff51847af46ed98b6902b610cfc6f/users/d42e1edb53224f829b4e7e5f67f239bf/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.641640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedc96b-14da-4033-8c1f-cfc075de0201 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.658600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.660132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.660516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.660901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.663348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.667124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88aff51847af46ed98b6902b610cfc6f, user_id=d42e1edb53224f829b4e7e5f67f239bf, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.667298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.670376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.693245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 819/1631] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:15.694379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.698076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 813/1632] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:15 2022] PUT /identity/v3/projects/88aff51847af46ed98b6902b610cfc6f/users/d42e1edb53224f829b4e7e5f67f239bf/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:15.699121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.709830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:15.716073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db5583-74aa-461a-a30b-ae0ee8f67182 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.842067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ef8-b7fe-4f7d-ad0f-750513563106 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:15.842850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.843986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.845511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.846027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] PATH_INFO: `/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9/users/222809c593a24d84bc4c0a57d5c05306/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.850126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:15.851190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92f9bddefaa47a9a4f14c58854d99c9, user_id=222809c593a24d84bc4c0a57d5c05306, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.851730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.852057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.852343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] PATH_INFO: `/v3/projects/3dcabdc2d3c844eb961a7a9edb119777/users/a9b615424c074405a31be39f624b7ecc/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.854471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcabdc2d3c844eb961a7a9edb119777, user_id=a9b615424c074405a31be39f624b7ecc, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:15.857892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.861595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aba32-2195-42cc-9418-e6b17fb9d107 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:15.885751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 814/1633] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:15 2022] PUT /identity/v3/projects/3dcabdc2d3c844eb961a7a9edb119777/users/a9b615424c074405a31be39f624b7ecc/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:15.887463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:15.903088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 820/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:15 2022] PUT /identity/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9/users/222809c593a24d84bc4c0a57d5c05306/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:15.904470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:15.904762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:15.905044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:15.975622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] MFA Rules not processed for user `a9b615424c074405a31be39f624b7ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:15.976924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:15.989096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:16.008689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ba016-ce66-4f7f-9b48-188561ec6fd7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.111410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.112031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.112575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.112685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.113360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.115025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc939-5fa7-45b5-bc0a-b8d2e8045e2a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.135374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 815/1635] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:16.137989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b8d2-683d-48f1-85b4-81204ab76120 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.138530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b8d2-683d-48f1-85b4-81204ab76120 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.139217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b8d2-683d-48f1-85b4-81204ab76120 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.146426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 816/1636] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 23 09:10:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:16.148297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.149028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.149477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.172526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 821/1637] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:16.173455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:16.195640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f03bd7-275a-48b6-94bb-7af30299bce3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.208612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] MFA Rules not processed for user `222809c593a24d84bc4c0a57d5c05306`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:16.210211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:16.212439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.213376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.213669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.213950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] PATH_INFO: `/v3/projects/88aff51847af46ed98b6902b610cfc6f/users/d42e1edb53224f829b4e7e5f67f239bf/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.216835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=88aff51847af46ed98b6902b610cfc6f, user_id=d42e1edb53224f829b4e7e5f67f239bf, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.219545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a342-5f98-4a5d-964e-3134b7a2bfae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.246828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 822/1638] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:16 2022] PUT /identity/v3/projects/88aff51847af46ed98b6902b610cfc6f/users/d42e1edb53224f829b4e7e5f67f239bf/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:16.249209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea280d-3818-4941-855c-9c48482cff6e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.250893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea280d-3818-4941-855c-9c48482cff6e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.251278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea280d-3818-4941-855c-9c48482cff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.296002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-64ea280d-3818-4941-855c-9c48482cff6e None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:16.297313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-64ea280d-3818-4941-855c-9c48482cff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:16.359493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 817/1639] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:16.360521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:16.425722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 823/1640] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:16.428033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.428442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.428853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.440534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:16.485759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] MFA Rules not processed for user `d42e1edb53224f829b4e7e5f67f239bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:16.489240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:16.511077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17c1c-c1c6-421e-8192-cb7f3646cc6c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.594161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:16.620674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.621832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.622113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.622389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.646513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 824/1641] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:16.646513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:16.665210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae17a-5820-459d-a081-3ff1a0d5b55e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.674928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.675178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.675482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.675770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.768847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.770322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.796652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 818/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:16.812727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.814190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.838281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 825/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:16.890131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:16.899841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbbf71-ab56-4762-ac4b-08b12e2a1280 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.911276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:16.919480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.920227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.920639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.920957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.923931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133f06b-3ab3-4e34-8215-4c6190997fe5 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:16.929117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:16.929992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:16.931390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:16.931775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:16.946177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.947926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.960412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:16.962318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:16.977263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 826/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:16.980745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 819/1645] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:17.977388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.102833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.116448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac4a04-973b-4f8e-a6f8-fc9ca1c74f78 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.134683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222809c593a24d84bc4c0a57d5c05306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd92f9bddefaa47a9a4f14c58854d99c9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.135620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.138056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.138565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.139676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:18.142763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.144806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.160804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9afa-33e5-4fd1-bbb8-e56ec362cb9e service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.174670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.175937 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.176203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 820/1646] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:10:18.177316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.177902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.179262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] PATH_INFO: `/v3/users/fbf3cd30ee4047cf93573e6d7926aeff` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.184494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf3cd30ee4047cf93573e6d7926aeff)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.185742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: WARNING py.warnings [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:18.185742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: warnings.warn(msg) Jun 23 09:10:18.185742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: Jun 23 09:10:18.189385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.204743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dfabb-fdbf-4ef4-ba13-7e72148bd3e1 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.210323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:18.220685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222809c593a24d84bc4c0a57d5c05306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd92f9bddefaa47a9a4f14c58854d99c9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.221746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.222272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.222771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.223841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.226051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.298928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 821/1647] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:18 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:18.301531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.350248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf3cd30ee4047cf93573e6d7926aeff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.379562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf3cd30ee4047cf93573e6d7926aeff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.382885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf3cd30ee4047cf93573e6d7926aeff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.408336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf3cd30ee4047cf93573e6d7926aeff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.409389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-229de6bf-0390-440d-a650-54b5ce9e8909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf3cd30ee4047cf93573e6d7926aeff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.459279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7b86e-4b67-411e-a8c8-db8bc1225342 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.463697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 827/1648] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:17 2022] DELETE /identity/v3/users/fbf3cd30ee4047cf93573e6d7926aeff => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:18.467943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.468365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.468742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.476355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222809c593a24d84bc4c0a57d5c05306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd92f9bddefaa47a9a4f14c58854d99c9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.478284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.478723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.479073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.481074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:18.483062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.487743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.513131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:18.515246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:18.526775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 822/1649] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:18.606872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 828/1650] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:18.627575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.629682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:18.644696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:18.647527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:18.685844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbc3a4-a260-43dd-b169-a7354ac1d171 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.801197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:18.826408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f901c-bce1-410b-a5a3-2b58b554d826 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:18.838892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.841597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.842121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.842707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.863939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222809c593a24d84bc4c0a57d5c05306', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd92f9bddefaa47a9a4f14c58854d99c9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:18.865039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:18.865391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:18.865680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] PATH_INFO: `/v3/projects/315a9872a19e4a3abcdca2c15a8d7b15` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:18.869910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=315a9872a19e4a3abcdca2c15a8d7b15)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.872265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: WARNING py.warnings [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 09:10:18.872265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: warnings.warn(msg) Jun 23 09:10:18.872265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: Jun 23 09:10:18.875047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.875786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:18.878434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76cd9e-ffe2-4f9e-b648-3c88700d3ce5 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:18.907996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 829/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:18.957479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315a9872a19e4a3abcdca2c15a8d7b15', 'request_id': 'req-61342889-7249-4c8a-a4c0-3066cc9a2e27'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.969644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315a9872a19e4a3abcdca2c15a8d7b15', 'request_id': 'req-61342889-7249-4c8a-a4c0-3066cc9a2e27'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:18.988682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315a9872a19e4a3abcdca2c15a8d7b15', 'request_id': 'req-61342889-7249-4c8a-a4c0-3066cc9a2e27'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:19.019987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] The token cache is being invalidate because project 315a9872a19e4a3abcdca2c15a8d7b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:19.020741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:19.021545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-61342889-7249-4c8a-a4c0-3066cc9a2e27 tempest-VolumeQuotaClassesTest-1376365325 tempest-VolumeQuotaClassesTest-1376365325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:19.024495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 823/1652] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:18 2022] DELETE /identity/v3/projects/315a9872a19e4a3abcdca2c15a8d7b15 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:19.092224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7c5f-dda7-478d-98c3-0938766eee29 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.092796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7c5f-dda7-478d-98c3-0938766eee29 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.092893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d7c5f-dda7-478d-98c3-0938766eee29 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.094355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 830/1653] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 23 09:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:19.110741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaeb1-d70f-4e6a-9042-2e14836a7751 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.111282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaeb1-d70f-4e6a-9042-2e14836a7751 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.111282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eaeb1-d70f-4e6a-9042-2e14836a7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.160098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d90eaeb1-d70f-4e6a-9042-2e14836a7751 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:19.168223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d90eaeb1-d70f-4e6a-9042-2e14836a7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:19.331363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 824/1654] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 23 09:10:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:19.331993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.332350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.332689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.336289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 831/1655] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 23 09:10:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:19.345816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.346329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.346810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.441397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:19.441397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:19.441397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 825/1656] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:10:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:19.525435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:19.527734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:19.542450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:19.543852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:19.697969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:19.757884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:19.788520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a60849-43bc-40a8-ba7e-2a123f3f8ee6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:19.795340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:19.797321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.797787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.798334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.803944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabd367-ebd9-4912-b8d2-a8eec97b0630 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:19.820084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:19.821030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:19.821321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:19.821707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] PATH_INFO: `/v3/users/92472668d49a4092b3c92bfce521189a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:19.836736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92472668d49a4092b3c92bfce521189a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:19.843459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:19.848640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:19.850441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031c18b-e8fe-4dae-ada4-9b502ebe7cf8 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:19.890204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 832/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:20.011808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92472668d49a4092b3c92bfce521189a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.012994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92472668d49a4092b3c92bfce521189a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.038580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92472668d49a4092b3c92bfce521189a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.063727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92472668d49a4092b3c92bfce521189a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.064532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92472668d49a4092b3c92bfce521189a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.111341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 826/1658] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:19 2022] DELETE /identity/v3/users/92472668d49a4092b3c92bfce521189a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:20.116048 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:20.116533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:20.116847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:20.150112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:20.173064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:20.388142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 833/1659] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:20.444295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:20.450176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:20.491458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965662-cd2a-44f2-9ec7-00caf0250215 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:20.519619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:20.520942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:20.521360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:20.521940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] PATH_INFO: `/v3/projects/267cdc59ed8947b9a308684826284879` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:20.525756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267cdc59ed8947b9a308684826284879)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:20.535700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:20.572120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:20.574427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:20.669424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267cdc59ed8947b9a308684826284879', 'request_id': 'req-d0915dfb-243b-4956-a507-dd253cefb343'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.681335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267cdc59ed8947b9a308684826284879', 'request_id': 'req-d0915dfb-243b-4956-a507-dd253cefb343'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.706841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267cdc59ed8947b9a308684826284879', 'request_id': 'req-d0915dfb-243b-4956-a507-dd253cefb343'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.729098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] The token cache is being invalidate because project 267cdc59ed8947b9a308684826284879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:20.730231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.731417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:20.733311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 827/1660] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:20 2022] DELETE /identity/v3/projects/267cdc59ed8947b9a308684826284879 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:20.737388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:20.741016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:20.823121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631767-8a59-44bd-a235-f8dc2240d857 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:20.947308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:20.974817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:20.976945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:20.977361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:20.978431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:20.984245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:21.002428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0915dfb-243b-4956-a507-dd253cefb343 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:21.016967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:21.022036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:21.025171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:21.026089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:21.026376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:21.026732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] PATH_INFO: `/v3/users/d42e1edb53224f829b4e7e5f67f239bf` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:21.032879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42e1edb53224f829b4e7e5f67f239bf)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:21.034870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:21.054717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 834/1661] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:21.206298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42e1edb53224f829b4e7e5f67f239bf'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.207878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42e1edb53224f829b4e7e5f67f239bf'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.230825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42e1edb53224f829b4e7e5f67f239bf'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.252059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42e1edb53224f829b4e7e5f67f239bf'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.253035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42e1edb53224f829b4e7e5f67f239bf'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.342687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 828/1662] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:20 2022] DELETE /identity/v3/users/d42e1edb53224f829b4e7e5f67f239bf => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:10:21.477585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:21.481027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:21.507254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac09ba-5e7f-4832-a66d-24de14e0d3f6 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:21.580157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:21.651045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:21.654242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:21.669451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:21.670577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:21.671002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:21.671417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] PATH_INFO: `/v3/users/5d9e82fb533f48e9882998804f1eaadd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:21.672855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9e82fb533f48e9882998804f1eaadd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:21.675540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:21.794036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9e82fb533f48e9882998804f1eaadd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.803019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9e82fb533f48e9882998804f1eaadd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.803813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9e82fb533f48e9882998804f1eaadd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.816302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9e82fb533f48e9882998804f1eaadd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.817011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4b2003ae-481a-4127-9529-28a2c92605bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9e82fb533f48e9882998804f1eaadd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:21.847325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 835/1663] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:21 2022] DELETE /identity/v3/users/5d9e82fb533f48e9882998804f1eaadd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:21.848765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:21.848952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:21.849188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:21.874930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9e7f8-b87b-4b69-b1dd-417033a70673 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:21.891458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:21.893249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:21.992773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 836/1664] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:22.014456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:22.016285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:22.017000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:22.017420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] PATH_INFO: `/v3/users/00fd84606a8e43fb814c68ccf1055338` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:22.018896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fd84606a8e43fb814c68ccf1055338)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:22.022046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:22.068825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:22.089324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:22.095428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:22.158094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fd84606a8e43fb814c68ccf1055338'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:22.161191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fd84606a8e43fb814c68ccf1055338'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:22.177411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fd84606a8e43fb814c68ccf1055338'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:22.199452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fd84606a8e43fb814c68ccf1055338'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:22.200288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-852d0a22-7d31-448f-8fd3-0643b7ca185b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fd84606a8e43fb814c68ccf1055338'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:22.257527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 829/1665] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:21 2022] DELETE /identity/v3/users/00fd84606a8e43fb814c68ccf1055338 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:22.264153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:22.264676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:22.266666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:22.270166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b439e6-8f2c-44a8-930c-31a09b8d0e70 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:22.295867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:22.341873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:22.349371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:22.451723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:22.452642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:22.452932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:22.453494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:22.459675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:22.578348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 830/1666] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:22.614905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:22.617636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:22.640590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe47c78-e873-4b22-8688-b8c6e5d430f4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:22.651359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:22.652308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:22.652824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:22.653211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:22.675263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:22.676203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:22.677903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc17961-6371-408d-a03b-408b5d6833a5 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:22.679300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:22.713272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 837/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:22.715524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 831/1668] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:22.985696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:22.992983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:23.037084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0109cd-c080-475a-9e3b-f43e96a1e747 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:23.051682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614875-105d-496b-8173-650410327514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:23.052675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614875-105d-496b-8173-650410327514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.053426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614875-105d-496b-8173-650410327514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.053722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614875-105d-496b-8173-650410327514 admin admin] PATH_INFO: `/v3/projects/88aff51847af46ed98b6902b610cfc6f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.056227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614875-105d-496b-8173-650410327514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88aff51847af46ed98b6902b610cfc6f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:23.060097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614875-105d-496b-8173-650410327514 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:23.154945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88aff51847af46ed98b6902b610cfc6f', 'request_id': 'req-ef614875-105d-496b-8173-650410327514'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:23.169232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88aff51847af46ed98b6902b610cfc6f', 'request_id': 'req-ef614875-105d-496b-8173-650410327514'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:23.178094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88aff51847af46ed98b6902b610cfc6f', 'request_id': 'req-ef614875-105d-496b-8173-650410327514'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:23.198047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] The token cache is being invalidate because project 88aff51847af46ed98b6902b610cfc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:23.198393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:23.199231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ef614875-105d-496b-8173-650410327514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:23.201516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 838/1669] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:22 2022] DELETE /identity/v3/projects/88aff51847af46ed98b6902b610cfc6f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:23.206239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.206694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.207479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.251868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:23.254405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:23.414212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 832/1670] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:23.422513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ee23-727c-46fe-8859-474a2078108e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.422799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ee23-727c-46fe-8859-474a2078108e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.423079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ee23-727c-46fe-8859-474a2078108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.463432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c154ee23-727c-46fe-8859-474a2078108e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:23.465287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c154ee23-727c-46fe-8859-474a2078108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:23.494113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 839/1671] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:23.499491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:23.514812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf51e9f-3b00-466f-be07-8b3e94bbb211 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:23.535540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:23.536495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.536869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.537214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.538062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:23.538449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:23.540258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:23.588164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 833/1672] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:23.591923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ee23-727c-46fe-8859-474a2078108e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:23.606543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ee23-727c-46fe-8859-474a2078108e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:23.621115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:23.621808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.622100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.622375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.623286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:23.630295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:23.702573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 840/1673] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:23 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:23.704965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:23.727641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3fab-b712-4009-a2c3-861bf527df95 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:23.753421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:23.757788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:23.761170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:23.825231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:23.932226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:23.932937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.933780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.935874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.935874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:23.937223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:23.964647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b99b5-6c10-469f-91db-90e93088a916 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:23.975139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:23.975981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:23.976275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:23.978193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] PATH_INFO: `/v3/projects/07f8c4083f0d434dbdda1674fbe2cc07` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:23.991500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f8c4083f0d434dbdda1674fbe2cc07)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:23.993647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:24.005719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 834/1674] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:23 2022] POST /identity/v3/users => generated 278 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:24.012569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.042556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7f427-763a-45ae-92c4-e87bdaab6804 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:24.069951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:24.070658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.070945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.071225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.075737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:24.077472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:24.112828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 835/1675] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:24.118353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.144308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35269f-d163-47d6-9958-c03339e38480 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:24.153793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f8c4083f0d434dbdda1674fbe2cc07', 'request_id': 'req-8195d8fb-b5d4-4d61-b330-945c3cd66c23'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.172202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f8c4083f0d434dbdda1674fbe2cc07', 'request_id': 'req-8195d8fb-b5d4-4d61-b330-945c3cd66c23'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.181367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f8c4083f0d434dbdda1674fbe2cc07', 'request_id': 'req-8195d8fb-b5d4-4d61-b330-945c3cd66c23'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.237021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] The token cache is being invalidate because project 07f8c4083f0d434dbdda1674fbe2cc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:24.237218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.238772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.251258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 841/1676] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:23 2022] DELETE /identity/v3/projects/07f8c4083f0d434dbdda1674fbe2cc07 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:10:24.255081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.256409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:24.256822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.257090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.257358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.257634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.258378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:24.259999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:24.282057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d8fb-b5d4-4d61-b330-945c3cd66c23 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:24.289972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 836/1677] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:24.295769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.297983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:24.298899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.299192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.299480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] PATH_INFO: `/v3/users/222809c593a24d84bc4c0a57d5c05306` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.300194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.304452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222809c593a24d84bc4c0a57d5c05306)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:24.306717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:24.334493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded37d5-363b-4c82-b115-e5758f6fac66 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:24.349852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:24.351080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.351558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.353033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] PATH_INFO: `/v3/projects/384e43db976a495fb61920d89a07a938/users/13031f630cc24774a3c0a95cb6ba9f57/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.389951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384e43db976a495fb61920d89a07a938, user_id=13031f630cc24774a3c0a95cb6ba9f57, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:24.395276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655a8d3-0080-4654-966f-0bfa7ef2b598 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:24.426902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 837/1678] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:24 2022] PUT /identity/v3/projects/384e43db976a495fb61920d89a07a938/users/13031f630cc24774a3c0a95cb6ba9f57/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:24.438628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.439192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.440183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.443054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222809c593a24d84bc4c0a57d5c05306'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.460022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222809c593a24d84bc4c0a57d5c05306'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.461518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222809c593a24d84bc4c0a57d5c05306'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.482299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222809c593a24d84bc4c0a57d5c05306'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.482959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ed525f68-b138-4e92-b8d6-1789c6bcd573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222809c593a24d84bc4c0a57d5c05306'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:24.512820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] MFA Rules not processed for user `13031f630cc24774a3c0a95cb6ba9f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:24.514958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.526021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 842/1679] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:24 2022] DELETE /identity/v3/users/222809c593a24d84bc4c0a57d5c05306 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:24.652618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.652911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.653199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.680774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:24.707745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 838/1680] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:24 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:24.711825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.713797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] MFA Rules not processed for user `cc4f7b9f69ab47a39e1219a0605e7049`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:24.715092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.715747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.725167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:24.859863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a10c9-3fdb-44cb-a33f-ac85ce7a7d1b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:24.880591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 843/1681] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:24.895155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:24.896622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:24.987518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:24.988358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:24.988768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:24.989055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:24.989783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:24.991720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.049794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9540-ebdf-4c92-b219-07860f66c56c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.055547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 839/1682] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:24 2022] POST /identity/v3/projects => generated 357 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:25.056550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.194288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcfd9b-5533-4ce5-96b1-70ddcfa4c351 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.205815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.206514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.206799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.207078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.207839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.211414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.228748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.229419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.229709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.230534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.264506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 840/1683] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:25 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:25.268210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.322680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18db02-499e-4484-a2d9-7a18437d9ec1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.353440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.354486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.355453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.356612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.357578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.363369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.368903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:25.391814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.393834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.407997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 841/1684] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:25.414909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.416271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 844/1685] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:25.424633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:25.431014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b074b-d7d5-4ba4-87c3-09927c75cd3b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.438891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.440699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.441375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.442202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] PATH_INFO: `/v3/projects/39f516cf517e42578cd44b5db9f0e874/users/b8628b4b637140e88eff1e03883c7add/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.466809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f516cf517e42578cd44b5db9f0e874, user_id=b8628b4b637140e88eff1e03883c7add, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.471423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.507048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 842/1686] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:25 2022] PUT /identity/v3/projects/39f516cf517e42578cd44b5db9f0e874/users/b8628b4b637140e88eff1e03883c7add/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:25.510969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.530225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff0862-aff4-4f41-bbcf-34933333f073 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.554501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.557029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:25.703010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.704575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.705010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.705366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.706838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.709949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.753472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 845/1687] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:25.757717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:25.766714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de474c8-1ace-4203-afcf-5e1826548257 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.780864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.781757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.782040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.782318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] PATH_INFO: `/v3/projects/5d6b31bf3ac24b76a649aaa7183b0c37` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.785760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6b31bf3ac24b76a649aaa7183b0c37)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.788787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562ae8-bcde-43b0-9817-d7f4a10ac8f6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:25.795908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.801709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:25.803084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.803391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.804616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] PATH_INFO: `/v3/projects/39f516cf517e42578cd44b5db9f0e874/users/b8628b4b637140e88eff1e03883c7add/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.808649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f516cf517e42578cd44b5db9f0e874, user_id=b8628b4b637140e88eff1e03883c7add, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:25.813883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b5638-a735-491b-8a87-ff65d9fa491f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:25.850577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 846/1688] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:25 2022] PUT /identity/v3/projects/39f516cf517e42578cd44b5db9f0e874/users/b8628b4b637140e88eff1e03883c7add/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:25.853447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:25.853812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:25.854022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:25.949438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6b31bf3ac24b76a649aaa7183b0c37', 'request_id': 'req-6c348ee6-8833-41c2-b39c-f0d03be297d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:25.957334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] MFA Rules not processed for user `b8628b4b637140e88eff1e03883c7add`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:25.958776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:25.983720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6b31bf3ac24b76a649aaa7183b0c37', 'request_id': 'req-6c348ee6-8833-41c2-b39c-f0d03be297d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.009206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6b31bf3ac24b76a649aaa7183b0c37', 'request_id': 'req-6c348ee6-8833-41c2-b39c-f0d03be297d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.034977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] The token cache is being invalidate because project 5d6b31bf3ac24b76a649aaa7183b0c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:26.035331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.037193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.047111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 843/1689] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:25 2022] DELETE /identity/v3/projects/5d6b31bf3ac24b76a649aaa7183b0c37 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:10:26.048117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:26.052425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:26.107751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 847/1690] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:25 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:26.117566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:26.122749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:26.207008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348ee6-8833-41c2-b39c-f0d03be297d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:26.212338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:26.213249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:26.213541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:26.213824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] PATH_INFO: `/v3/users/a9b615424c074405a31be39f624b7ecc` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:26.215166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b615424c074405a31be39f624b7ecc)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:26.218023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:26.232856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:26.285959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:26.295797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ac89-e979-4dda-8983-aecd5521b50c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:26.297783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b615424c074405a31be39f624b7ecc'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.298825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b615424c074405a31be39f624b7ecc'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.307947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b615424c074405a31be39f624b7ecc'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.310829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:26.311503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:26.311793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:26.312098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:26.323075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b615424c074405a31be39f624b7ecc'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.325555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b615424c074405a31be39f624b7ecc'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.336189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:26.337836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:26.401798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 848/1691] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:26 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:26.405257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:26.407325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 844/1692] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:26 2022] DELETE /identity/v3/users/a9b615424c074405a31be39f624b7ecc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:26.412530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:26.465249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe488-0016-4128-acbc-fc41c0d34185 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:26.548889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:26.551780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:26.609673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:26.610662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:26.611008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:26.611323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] PATH_INFO: `/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:26.612953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92f9bddefaa47a9a4f14c58854d99c9)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:26.616728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:26.709036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92f9bddefaa47a9a4f14c58854d99c9', 'request_id': 'req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.728350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92f9bddefaa47a9a4f14c58854d99c9', 'request_id': 'req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.739028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92f9bddefaa47a9a4f14c58854d99c9', 'request_id': 'req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.763559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] The token cache is being invalidate because project d92f9bddefaa47a9a4f14c58854d99c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:26.765047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.766785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:26.775061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 849/1693] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:26 2022] DELETE /identity/v3/projects/d92f9bddefaa47a9a4f14c58854d99c9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:26.776063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:26.776490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ce37-b502-4a60-8185-84052ca440fa admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:26.780097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:26.984700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529e45-ad8b-4b2a-a6b5-3f7b91657eb7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:26.986458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:26.987362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:26.987646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:26.993915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] PATH_INFO: `/v3/projects/2d8efe66a22b44c09e8f03759481943c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:26.996874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8efe66a22b44c09e8f03759481943c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.000728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:27.001410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.004102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:27.004400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.004711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.013271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:27.090892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:27.184471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.185951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd364e-8a17-4ba0-9acd-b15bf40e2243 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:27.193911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:27.202933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 850/1694] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:26 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:27.223321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8efe66a22b44c09e8f03759481943c', 'request_id': 'req-6c780f36-822c-40fd-b640-2556845d6de8'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:27.232304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356766-f68a-428b-b7e3-ed9af9c89e8d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.240054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356766-f68a-428b-b7e3-ed9af9c89e8d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.240609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356766-f68a-428b-b7e3-ed9af9c89e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.243813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8efe66a22b44c09e8f03759481943c', 'request_id': 'req-6c780f36-822c-40fd-b640-2556845d6de8'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:27.267675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8efe66a22b44c09e8f03759481943c', 'request_id': 'req-6c780f36-822c-40fd-b640-2556845d6de8'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:27.282093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ed356766-f68a-428b-b7e3-ed9af9c89e8d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:27.285055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ed356766-f68a-428b-b7e3-ed9af9c89e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:27.292962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] The token cache is being invalidate because project 2d8efe66a22b44c09e8f03759481943c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:27.298348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:27.299486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6c780f36-822c-40fd-b640-2556845d6de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:27.311087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 845/1695] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:26 2022] DELETE /identity/v3/projects/2d8efe66a22b44c09e8f03759481943c => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:27.315018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9723-cc7b-4462-b429-72ea6d689480 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.315362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9723-cc7b-4462-b429-72ea6d689480 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.315656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c9723-cc7b-4462-b429-72ea6d689480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.379768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8b6c9723-cc7b-4462-b429-72ea6d689480 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:27.380974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8b6c9723-cc7b-4462-b429-72ea6d689480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:27.533930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 851/1696] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:27.541822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.542251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.543244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.638122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 846/1697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:27.644425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:27.646291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:27.649118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.649443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.649748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.697814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 852/1698] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:27.702655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:27.703689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:27.704965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:27.718154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 847/1699] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:27.719339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:27.729914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec1dc-864a-4568-b227-44df163f0319 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:27.736015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4e78c-5144-4d40-9bbc-fcfa6a15862a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:27.743499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:27.744537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.745005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.745462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.746589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:27.747141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.749054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:27.753265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:27.758920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.762919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.763313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.767577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:27.768221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.772253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 848/1700] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:27.773508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:27.780224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:27.801466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c92c5-1a0e-41ab-b2a8-77467a1a4ee5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:27.815502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:27.817261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.817615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.817913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.818735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.821193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:27.838925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 853/1701] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:27.840597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:27.868314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e00a07-f37f-4ac0-a4f1-2ecf8c85d369 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:27.883625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 849/1702] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:27.889151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:27.889948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:27.890327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:27.890728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:27.892049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:27.894883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:27.903573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.012069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 854/1703] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:28.012905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.022216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.112092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c172e5-b349-4123-ae42-4d6ad1248f16 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.200221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:28.212227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacbe76-1879-4858-b546-81a6caff364a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.218060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.218953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.219237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.219754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] PATH_INFO: `/v3/projects/3dcabdc2d3c844eb961a7a9edb119777` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.228923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcabdc2d3c844eb961a7a9edb119777)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.231229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.259185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.259764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.260150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.260425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.261766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.264463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.308009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 850/1704] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:27 2022] POST /identity/v3/users => generated 283 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:28.309168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.311771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:28.330447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a89e55-c158-4fa4-aaa8-3c32af8eca64 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.343832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcabdc2d3c844eb961a7a9edb119777', 'request_id': 'req-6e407718-aa94-46c0-835a-93598e636088'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:28.367450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcabdc2d3c844eb961a7a9edb119777', 'request_id': 'req-6e407718-aa94-46c0-835a-93598e636088'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:28.375750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcabdc2d3c844eb961a7a9edb119777', 'request_id': 'req-6e407718-aa94-46c0-835a-93598e636088'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:28.397875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] The token cache is being invalidate because project 3dcabdc2d3c844eb961a7a9edb119777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:28.398193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:28.400343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:28.404840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 855/1705] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:28 2022] DELETE /identity/v3/projects/3dcabdc2d3c844eb961a7a9edb119777 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:28.408328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.413596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.470797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.471497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.471785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.472106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.472817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.474911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523edd-a479-4a42-b010-b4ab82a19538 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.514263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 851/1706] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:28 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:28.518764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.519053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.519485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.557051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:28.558885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.570806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e407718-aa94-46c0-835a-93598e636088 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.581367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.582050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.582628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 852/1707] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:28.583122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.583405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.589881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.591608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.592102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.603880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.604874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5fe91-8353-4ec2-8c66-6debc3980569 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.611294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.613393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.613658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.613934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.614692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.616460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38339-75cc-4691-aeea-eaa0d2aaa62e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.638264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 853/1708] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:28.649857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 856/1709] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:28.650718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.651346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.651650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.651987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.672406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a1f58-9a81-4516-a598-f6749ac2ae8c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.690089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.690756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.691044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.691327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.692102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.693670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:28.694917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.696761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cab9c8-6c09-4d43-8db3-289696e8191d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.713719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 854/1710] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:28.714843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.723430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 857/1711] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:28.729137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.729575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.730388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.739021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb2cd2-2a14-4611-9571-0577d7a1ed88 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.755339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.756168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.756559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.756951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.757801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.759515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.767813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] MFA Rules not processed for user `20a6d94b2d03465cb3e7619609084680`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:28.769074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:28.796313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 855/1712] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:28.797985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.826922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408f236-b1fb-436f-b6df-8779712bf7c1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.849038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.849839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.851111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.852692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.853624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:28.857772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.861683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.880098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 858/1713] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:28.881735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.906286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 856/1714] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:28.907355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:28.912303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6e46-42f3-4b3d-a8e8-bf0882d0d4a1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.926391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86c8d9-4955-46e1-bf3e-e677587e7675 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:28.928858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.930033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.930427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.930959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] PATH_INFO: `/v3/projects/3dc9d573e30e475b8d117aca5fcd1f6a/users/1cf47995deb947db8a85bc44fae00d81/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.932453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:28.937865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:28.938530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:28.938816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] PATH_INFO: `/v3/projects/71421eddf5ca4ccdb4795cbbc96b69fc/users/e684ae1ce8584e08ab876bcba533e5c4/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:28.958288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc9d573e30e475b8d117aca5fcd1f6a, user_id=1cf47995deb947db8a85bc44fae00d81, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.968631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:28.979734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71421eddf5ca4ccdb4795cbbc96b69fc, user_id=e684ae1ce8584e08ab876bcba533e5c4, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:28.985905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:29.025633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 857/1715] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:28 2022] PUT /identity/v3/projects/71421eddf5ca4ccdb4795cbbc96b69fc/users/e684ae1ce8584e08ab876bcba533e5c4/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:29.026756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:29.032413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 859/1716] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:28 2022] PUT /identity/v3/projects/3dc9d573e30e475b8d117aca5fcd1f6a/users/1cf47995deb947db8a85bc44fae00d81/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:29.033407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:29.038372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:29.078163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:29.197836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:29.219430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a41eb8-2289-42eb-8852-50a3d4614eb8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:29.234586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:29.235300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:29.235587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:29.235862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:29.236614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:29.238691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f6908-9350-4fb4-8675-78d3e186d0b8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:29.284846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4060f-c5df-49fe-90bb-55eb6b776a3d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:29.328244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 860/1717] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:29 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:29.332785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:29.333095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:29.333378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:29.445161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] MFA Rules not processed for user `e684ae1ce8584e08ab876bcba533e5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:29.447627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:29.482077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:29.482642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:29.487279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:29.487666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:29.664762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:29.666536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fdfbd-fd74-4eb2-ba5c-89c716722578 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:29.703460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 858/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:29.717211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3de08-dacf-4e8f-a5b3-8cbb1c224c74 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:29.721931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3de08-dacf-4e8f-a5b3-8cbb1c224c74 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:29.722557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3de08-dacf-4e8f-a5b3-8cbb1c224c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:29.746533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 861/1719] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:29.750087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:29.831117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-15a3de08-dacf-4e8f-a5b3-8cbb1c224c74 None None] MFA Rules not processed for user `1cf47995deb947db8a85bc44fae00d81`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:29.835301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-15a3de08-dacf-4e8f-a5b3-8cbb1c224c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:29.975592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5a71e-dd99-451f-bffa-c9384db12cab None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:29.988356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:29.989047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:29.989339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:29.989614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:29.990316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:29.992290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.054911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 862/1720] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:29 2022] POST /identity/v3/users => generated 290 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:30.056219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.076934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268042e4-f132-4f81-9531-6fb593c3fd19 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.091047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.091658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.091946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.092928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.093406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.095990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.130533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:30.148953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 863/1721] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:30.150405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.179577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 859/1722] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:30.181155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.181450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.189463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.208880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:30.260678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] MFA Rules not processed for user `e60614620eb847f79fb6abbf33f47c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:30.263302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:30.298344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa833c-6406-438c-bdb9-752e6f659c09 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.312960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.313761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.316502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.316798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.317707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.320533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.349274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 864/1723] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:30.351220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.382553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d21cf6-44a4-4eea-9376-72a183350e16 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.395765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.396504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.396790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.397111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.397821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.403409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.408050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 860/1724] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:30.409541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.445728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96dee-f48d-4950-9e8a-19c1e349ca27 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.451039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 865/1725] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:30.451965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.457334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.472781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.474372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.475048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.481903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23b1b2-7be7-405f-8034-5eee4121bc26 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.483009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.491817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.503525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.504265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.504546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.504825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.505756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.507439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124a50f-9104-42ca-867f-b59c3041fe2b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.532390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 866/1726] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:30.533760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.534628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.536468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.565496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 861/1727] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:30.565496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.581755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] MFA Rules not processed for user `e60614620eb847f79fb6abbf33f47c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:30.591465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:30.713025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 867/1728] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:30.714089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.732942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e6e0-4192-4d8b-b26c-6a5efa3a9538 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.736653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ebcc1-6db9-4391-bb9d-4856e0789c63 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.742804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.743510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.743797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.744113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.744864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.748738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.751033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.752020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.752305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.752627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] PATH_INFO: `/v3/projects/2393cdf0911941a6b7fa7fcf35033640/users/da4f11da1239449ca22dd925b138abeb/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.780672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 862/1729] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:30.782319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.793381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2393cdf0911941a6b7fa7fcf35033640, user_id=da4f11da1239449ca22dd925b138abeb, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.796838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.803659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c546ca-1684-4465-94ff-10dba4b99f72 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.812866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:30.814806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:30.816532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:30.821158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:30.825498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:30.830282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 868/1730] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:30 2022] PUT /identity/v3/projects/2393cdf0911941a6b7fa7fcf35033640/users/da4f11da1239449ca22dd925b138abeb/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:30.831791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:30.832784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.843106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:30.887809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 863/1731] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:30 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:30.895429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:30.924129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e247c2-f405-49e0-a980-1921d66f4f53 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:30.971674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:31.032659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f06bb-f594-4e68-a9e8-834e667591e1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:31.046850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:31.047603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.047932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.048238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.058085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:31.074125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:31.077920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.078231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.078600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] PATH_INFO: `/v3/projects/c19ca452d0bb47b792d706f87f0ba113/users/ce459d4fa2374c50a7702d6c54f5c332/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.111877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ca452d0bb47b792d706f87f0ba113, user_id=ce459d4fa2374c50a7702d6c54f5c332, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:31.115124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1ecfc-6613-484f-b8c6-c896599bb0e9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:31.149607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 864/1732] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:30 2022] PUT /identity/v3/projects/c19ca452d0bb47b792d706f87f0ba113/users/ce459d4fa2374c50a7702d6c54f5c332/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:31.153365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.154999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.155621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.244987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] MFA Rules not processed for user `da4f11da1239449ca22dd925b138abeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:31.251032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:31.349908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:31.353597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:31.373353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 869/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:31.374768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:31.399570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f3b70-d623-4001-a730-040c2bd7a651 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:31.479409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 865/1734] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:31.480807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:31.572181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:31.573454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.575082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.575374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.578089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:31.589912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:31.616290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 870/1735] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:31.617246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:31.642150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120552c3-030e-4f30-a137-695bd2332314 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:31.662562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9201-2d24-4ef2-8870-d2ef2e07feba None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:31.663817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:31.667012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.667990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.670756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.671525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:31.677445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:31.680510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:31.681203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:31.681487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:31.681766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:31.683881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:31.687376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:31.747174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 866/1736] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:31.748135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:31.784743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 871/1737] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:31 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:31.786499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:31.808550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774621-1329-41de-b546-a879a8001ee9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.014936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:32.036536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0bc4-8cdc-4b8e-8a3f-d82326c683c2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.062474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.063181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.063467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.063803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.063986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.064579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:32.066699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:32.066833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.067469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.067919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:32.068603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] PATH_INFO: `/v3/projects/c19ca452d0bb47b792d706f87f0ba113/users/ce459d4fa2374c50a7702d6c54f5c332/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.086141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ca452d0bb47b792d706f87f0ba113, user_id=ce459d4fa2374c50a7702d6c54f5c332, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:32.098303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:32.121051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 867/1738] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:32.122315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:32.144864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 872/1739] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:31 2022] PUT /identity/v3/projects/c19ca452d0bb47b792d706f87f0ba113/users/ce459d4fa2374c50a7702d6c54f5c332/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:32.152781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab17e1c-96bd-4d96-81b6-56ae808153c9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.153167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:32.295601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.296460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.296768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.297023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.297994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:32.302744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec31fc-3e62-4132-807b-04f4c72d0979 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:32.347817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85affbdd-5f95-4ae8-aa17-703ef4199227 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.351642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 868/1740] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:32 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:32.357791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04dba-3f38-4ca2-a390-2847b0c033d1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.358189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04dba-3f38-4ca2-a390-2847b0c033d1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.358819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04dba-3f38-4ca2-a390-2847b0c033d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.359067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.360013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.360306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.360582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] PATH_INFO: `/v3/projects/95c29ecd39de492db7c539331aa3921b/users/7859ac7a2ec14f3e8e37843886592308/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.413753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c29ecd39de492db7c539331aa3921b, user_id=7859ac7a2ec14f3e8e37843886592308, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:32.414934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-26e04dba-3f38-4ca2-a390-2847b0c033d1 None None] MFA Rules not processed for user `ce459d4fa2374c50a7702d6c54f5c332`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:32.416485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:32.417062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-26e04dba-3f38-4ca2-a390-2847b0c033d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:32.443537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 873/1741] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:32 2022] PUT /identity/v3/projects/95c29ecd39de492db7c539331aa3921b/users/7859ac7a2ec14f3e8e37843886592308/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:32.449501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:32.585957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5670-3026-46bd-b4b7-274a9b0ce368 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.593914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 869/1742] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:32.594096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.595105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.595401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.595686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.597250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:32.601517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.608284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e96215-7e72-4414-a8e8-38b9ad033716 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:32.608534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.608951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.648051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 874/1743] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:32.648051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.648051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.649797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.682172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] MFA Rules not processed for user `7859ac7a2ec14f3e8e37843886592308`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:32.686132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:32.701923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] MFA Rules not processed for user `cc4f7b9f69ab47a39e1219a0605e7049`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:32.704314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:32.840035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 875/1744] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:32.840035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:32.842156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:32.871502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:32.885501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 870/1745] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:32.887008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:32.913886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:32.916644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a47b6-3afa-432d-b45e-8f4765d6bd52 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:32.928962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:32.933559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:32.933871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:32.934169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] PATH_INFO: `/v3/projects/9a99923de4fe4faca0febe974526119f/users/d393e85f8b5a4c78a85a04729f16821b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:32.997906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a99923de4fe4faca0febe974526119f, user_id=d393e85f8b5a4c78a85a04729f16821b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.002947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.018829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c519bda-6a76-4d6a-b59c-bc870917d1b1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.032599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.033558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.033855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.034222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.052040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 871/1746] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:32 2022] PUT /identity/v3/projects/9a99923de4fe4faca0febe974526119f/users/d393e85f8b5a4c78a85a04729f16821b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:33.055845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.218579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad6c0-86e7-4356-876c-003a62750ff1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.236239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.236941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.237225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.237536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.238215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.243883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.246220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.247784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738a1d1-2d4d-4834-8747-98d3b07d4a37 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.305414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 872/1747] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:33 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:33.306306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.306482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 876/1748] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:33.320830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510dd5-652b-47da-b72b-6a3e899cb636 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.327612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510dd5-652b-47da-b72b-6a3e899cb636 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.330349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510dd5-652b-47da-b72b-6a3e899cb636 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.341714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 877/1749] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 23 09:10:33 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:33.348392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510dd5-652b-47da-b72b-6a3e899cb636 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.498961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ec079-f708-4f98-a7b1-1d9345032935 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.513912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.514692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.515691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.516572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.518151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.521701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1102d8-0012-4bbc-8eac-37c32015f098 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.557123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 873/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:33.557123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.557123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.557123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.618056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510dd5-652b-47da-b72b-6a3e899cb636 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.637887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.638719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.639076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.639455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.640262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.649295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.662734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:33.664198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:33.708220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 878/1751] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:33 2022] POST /identity/v3/users => generated 295 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:33.709174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.724276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:33.796365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:33.831563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 874/1752] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:33.832594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.867826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c6d2-8279-4610-be7a-27e000e18833 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.883411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.884362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.884651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.884936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] PATH_INFO: `/v3/projects/9a99923de4fe4faca0febe974526119f/users/d393e85f8b5a4c78a85a04729f16821b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.897096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a99923de4fe4faca0febe974526119f, user_id=d393e85f8b5a4c78a85a04729f16821b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:33.897471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178989-85b6-4d63-aa8f-233c3137a533 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:33.899984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:33.915153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:33.926100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:33.926462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:33.926823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:33.936027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 875/1753] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:33 2022] PUT /identity/v3/projects/9a99923de4fe4faca0febe974526119f/users/d393e85f8b5a4c78a85a04729f16821b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:33.937188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:33.954166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:34.066440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.068266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.131455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 879/1754] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:34.132577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:34.140459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:34.191903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6714ad5-2c87-4657-bcd3-d849593e0081 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.200356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc31e4-f06f-481f-9610-dc41618be404 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.216220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.217108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.217517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.217805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.218976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.221250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30974605-0021-41b8-b5ca-cea7e4562d77 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.251243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 876/1755] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:34.252693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.252990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.253276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.365266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] MFA Rules not processed for user `d393e85f8b5a4c78a85a04729f16821b`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:34.371394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:34.409345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.410344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.410635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.413819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.440158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.453051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.490854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 880/1756] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:34.492747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:34.545737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ac5a0-ccf4-4bd8-b5bf-c6ca2547f5c3 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.555051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.556877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.558095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.558666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] PATH_INFO: `/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a/users/7a11b4ca4b9a4d00af6ab48013f23a97/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.614026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=782ea8be58ea4a5dacf76d0c76844a3a, user_id=7a11b4ca4b9a4d00af6ab48013f23a97, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.617415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.656522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 881/1757] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:34 2022] PUT /identity/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a/users/7a11b4ca4b9a4d00af6ab48013f23a97/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:34.662073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:34.675511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 877/1758] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:34.698495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:34.833670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9066f-143f-492d-b55c-c999babc2cae admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.847170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.847945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.848256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.848543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.850361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.859011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.863819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db553fd-a567-41b5-94eb-db9b93e72334 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.885549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 882/1759] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:10:34.888124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:34.894536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:34.907674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd75-0dc5-420f-bbab-871e457d32e7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:34.915874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.916826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.917113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.917473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] PATH_INFO: `/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a/users/7a11b4ca4b9a4d00af6ab48013f23a97/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.921138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=782ea8be58ea4a5dacf76d0c76844a3a, user_id=7a11b4ca4b9a4d00af6ab48013f23a97, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:34.924153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd4d42-d85b-47cd-8013-2e7ce5821c5a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:34.954645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 883/1760] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:34 2022] PUT /identity/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a/users/7a11b4ca4b9a4d00af6ab48013f23a97/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:34.957488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ca44-9490-49aa-b87e-ea6a4b5fb9b5 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.957942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ca44-9490-49aa-b87e-ea6a4b5fb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.958226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ca44-9490-49aa-b87e-ea6a4b5fb9b5 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.960275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 884/1761] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 23 09:10:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:34.962305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe3b6-b9a4-4440-8668-e0aa2518e7f4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.962595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe3b6-b9a4-4440-8668-e0aa2518e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.962969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fe3b6-b9a4-4440-8668-e0aa2518e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:34.993772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:34.994450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:34.994824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:34.995110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.001148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:35.021448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e75fe3b6-b9a4-4440-8668-e0aa2518e7f4 None None] MFA Rules not processed for user `7a11b4ca4b9a4d00af6ab48013f23a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.024731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e75fe3b6-b9a4-4440-8668-e0aa2518e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.148857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:35.150440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89416b-f551-4793-995d-8b1e6603d372 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:35.191549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 878/1762] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:35.200349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1128987-e995-4e62-8ba5-9752b87e768d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.201344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1128987-e995-4e62-8ba5-9752b87e768d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.202028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1128987-e995-4e62-8ba5-9752b87e768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.270760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b1128987-e995-4e62-8ba5-9752b87e768d None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.273503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b1128987-e995-4e62-8ba5-9752b87e768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.395780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 879/1763] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:35.407178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.407469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.407753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.411482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 885/1764] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:35.413078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.413660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.413660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.442306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] MFA Rules not processed for user `20a6d94b2d03465cb3e7619609084680`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.444199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.466605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] MFA Rules not processed for user `77ef8043cfee4a97bc6990264dbd7b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.467858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.574846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 886/1765] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:35.576514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:35.578214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.602542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955617b6-c3aa-4675-a509-1c6a2d2dadb4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:35.608701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 880/1766] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:35.609620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:35.620439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:35.621155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.621409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.621685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.633025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:35.634847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2e7e3-19ed-4268-b6b7-e36cfaa2c791 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:35.671890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:35.679913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 887/1767] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:35.685191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c59d65-2c66-44c6-9c43-51cf76f610f7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.685191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c59d65-2c66-44c6-9c43-51cf76f610f7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.685481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c59d65-2c66-44c6-9c43-51cf76f610f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.774707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d4df-4e44-470e-8ccb-abdda269bbdb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:35.776068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-14c59d65-2c66-44c6-9c43-51cf76f610f7 None None] MFA Rules not processed for user `77ef8043cfee4a97bc6990264dbd7b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.778049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-14c59d65-2c66-44c6-9c43-51cf76f610f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:35.786945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:35.787894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.788306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.788631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.800887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 888/1768] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:35.802528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f1b9-0b6a-4629-89be-c5dbe7f7b163 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.805022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f1b9-0b6a-4629-89be-c5dbe7f7b163 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.807000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37f1b9-0b6a-4629-89be-c5dbe7f7b163 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.810018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 889/1769] 10.222.0.43 () {54 vars in 960 bytes} [Thu Jun 23 09:10:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:35.826821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:35.828431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:35.830903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:35.835983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:35.836532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:35.865163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 881/1770] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:35.887347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:35.891243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:36.009928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:36.023459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f0894-f2ab-43cf-925e-e5ded7ddbc19 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:36.050366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:36.050890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:36.051183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:36.053633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:36.084347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 890/1771] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Jun 23 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:36.092340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:36.118138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4aba-3a47-4912-9cb7-24f6c1446953 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:36.142481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:36.143178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:36.143468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:36.147021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:36.152490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:36.183757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:36.187050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:36.221831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 891/1772] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:36.232049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:36.236919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:36.258961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 882/1773] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:36.670567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:36.677453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:36.941908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6b5a-299e-4cb6-b5b0-874e454f300d service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:36.960198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:36.962404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:36.962404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:36.962404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:36.980948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:36.983860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6670c-5eae-48e6-a61b-e9c280b7221b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:37.031305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 892/1774] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:37.235124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:37.245676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b356e-bcf3-4c0e-9b6b-f6277cbf7ffd service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:37.260030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:37.262147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:37.263376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:37.264615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:37.420106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:37.423605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:37.465772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 883/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:38.534691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56433-8184-4b0a-bb51-c8612ff5c982 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:38.534691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56433-8184-4b0a-bb51-c8612ff5c982 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:38.535243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56433-8184-4b0a-bb51-c8612ff5c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:38.565003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2eb56433-8184-4b0a-bb51-c8612ff5c982 None None] MFA Rules not processed for user `77ef8043cfee4a97bc6990264dbd7b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:38.566245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2eb56433-8184-4b0a-bb51-c8612ff5c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:38.605192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 893/1776] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:38.766117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:38.874180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:38.925290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e475-7e93-4c49-97f7-62c901fd66c7 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:38.946020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:38.947551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:38.948087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:38.949263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] PATH_INFO: `/v3/users/e684ae1ce8584e08ab876bcba533e5c4` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:38.958231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e684ae1ce8584e08ab876bcba533e5c4)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:38.960608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:39.122577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e684ae1ce8584e08ab876bcba533e5c4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:39.127868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e684ae1ce8584e08ab876bcba533e5c4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:39.168936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e684ae1ce8584e08ab876bcba533e5c4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:39.201192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e684ae1ce8584e08ab876bcba533e5c4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:39.201850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e684ae1ce8584e08ab876bcba533e5c4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:39.248758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 884/1777] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:38 2022] DELETE /identity/v3/users/e684ae1ce8584e08ab876bcba533e5c4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:39.250115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:39.250640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:39.251345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:39.278142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:39.280417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:39.384137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 894/1778] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:39.395125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:39.396758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:39.536345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685b318-208c-4533-8f55-0090b9f469b8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:39.540863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:39.541798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:39.542319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:39.542815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:39.558493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:39.564053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41cb53-a197-4c67-9fdf-6820179c3887 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:39.613923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 885/1779] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:40.464643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:40.467630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:40.490872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009ddfb-573c-4566-86d5-5fb8b9fa28c2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:40.504507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:40.505836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:40.506302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:40.506720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] PATH_INFO: `/v3/users/1cf47995deb947db8a85bc44fae00d81` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:40.510162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf47995deb947db8a85bc44fae00d81)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:40.513965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:40.630255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf47995deb947db8a85bc44fae00d81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:40.662211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf47995deb947db8a85bc44fae00d81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:40.662793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf47995deb947db8a85bc44fae00d81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:40.706653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf47995deb947db8a85bc44fae00d81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:40.707429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e932c09f-0039-4810-9c22-03ffc6b8f793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf47995deb947db8a85bc44fae00d81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:40.733408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:40.761187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 895/1780] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:40 2022] DELETE /identity/v3/users/1cf47995deb947db8a85bc44fae00d81 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:40.762416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:40.762963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:40.763040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:40.811520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:40.813325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:40.879355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:40.879645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:40.880033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:40.937386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:40.939088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:40.974565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 886/1781] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:10:41.145079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 896/1782] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:41.205940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:41.207361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.257714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:41.262789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:41.265586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.304543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e710f5-70c3-41f5-b954-f5c032754e01 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:41.309139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:41.310019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:41.310304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:41.310843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] PATH_INFO: `/v3/projects/71421eddf5ca4ccdb4795cbbc96b69fc` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:41.312672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71421eddf5ca4ccdb4795cbbc96b69fc)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:41.317076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:41.448909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71421eddf5ca4ccdb4795cbbc96b69fc', 'request_id': 'req-4f917051-a7df-4df6-81d5-0bc482d46087'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:41.455178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca8ce1-4ff8-43e3-a019-7c6c24943d1d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:41.467467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71421eddf5ca4ccdb4795cbbc96b69fc', 'request_id': 'req-4f917051-a7df-4df6-81d5-0bc482d46087'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:41.477167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71421eddf5ca4ccdb4795cbbc96b69fc', 'request_id': 'req-4f917051-a7df-4df6-81d5-0bc482d46087'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:41.509675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] The token cache is being invalidate because project 71421eddf5ca4ccdb4795cbbc96b69fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:41.510411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:41.511894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:41.514367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 897/1783] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:41 2022] DELETE /identity/v3/projects/71421eddf5ca4ccdb4795cbbc96b69fc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:41.515544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:41.518595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.613628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:41.615144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:41.615411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:41.615707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:41.621283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.704524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917051-a7df-4df6-81d5-0bc482d46087 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:41.719777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:41.723261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:41.723794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:41.727661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:41.733250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.817081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:41.818514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:41.826106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:41.855750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 887/1784] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:41.857962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:41.860725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:41.891897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377e7c0-b338-4fcf-abbf-efba272fae1c service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:41.904040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:41.905577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:41.906886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:41.907179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] PATH_INFO: `/v3/users/ce459d4fa2374c50a7702d6c54f5c332` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:41.910681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce459d4fa2374c50a7702d6c54f5c332)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:41.912780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:41.925313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:41.928980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:41.971314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 898/1785] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:10:42.090030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce459d4fa2374c50a7702d6c54f5c332'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:42.090736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce459d4fa2374c50a7702d6c54f5c332'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:42.132715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce459d4fa2374c50a7702d6c54f5c332'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:42.154534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce459d4fa2374c50a7702d6c54f5c332'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:42.156160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fede23e4-e18f-4a81-a14e-b33172eddf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce459d4fa2374c50a7702d6c54f5c332'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:42.171636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:42.208460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 888/1786] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:41 2022] DELETE /identity/v3/users/ce459d4fa2374c50a7702d6c54f5c332 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:42.755341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:42.756995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:42.803374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1428-27d6-431e-a117-ca17486bb8bb service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:42.960985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:42.962016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:42.962419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:42.963184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] PATH_INFO: `/v3/users/da4f11da1239449ca22dd925b138abeb` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:42.966595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4f11da1239449ca22dd925b138abeb)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:42.974779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:43.112097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4f11da1239449ca22dd925b138abeb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:43.134617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4f11da1239449ca22dd925b138abeb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:43.136829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4f11da1239449ca22dd925b138abeb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:43.160711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4f11da1239449ca22dd925b138abeb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:43.161441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4f11da1239449ca22dd925b138abeb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:43.220778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 899/1787] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:42 2022] DELETE /identity/v3/users/da4f11da1239449ca22dd925b138abeb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:43.225812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023da-4232-4659-802c-e7c218278ab0 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:43.226704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023da-4232-4659-802c-e7c218278ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:43.227085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c023da-4232-4659-802c-e7c218278ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:43.282799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-16c023da-4232-4659-802c-e7c218278ab0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:43.286850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-16c023da-4232-4659-802c-e7c218278ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:43.613575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 889/1788] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:43.636019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:43.638311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:43.873651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:43.901236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988241-7832-41a8-a628-a77f7992b4b2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:43.910614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:43.912234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:43.912615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:43.912999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:43.943743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:43.945358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:43.979270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 900/1789] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:44.016045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9333b2-f82c-4a75-9b73-3f737171e74f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.016337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9333b2-f82c-4a75-9b73-3f737171e74f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.017531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9333b2-f82c-4a75-9b73-3f737171e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.110860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3a9333b2-f82c-4a75-9b73-3f737171e74f None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:44.129888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3a9333b2-f82c-4a75-9b73-3f737171e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.131771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:44.134193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.162015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8f62-d2a0-4467-90fc-38c300f3b3b3 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:44.174420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 890/1790] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jun 23 09:10:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:44.176694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:44.177811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.178612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.179218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] PATH_INFO: `/v3/projects/c19ca452d0bb47b792d706f87f0ba113` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.181953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19ca452d0bb47b792d706f87f0ba113)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:44.184012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:44.341936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19ca452d0bb47b792d706f87f0ba113', 'request_id': 'req-f1009801-cd45-439c-978b-19f1de0f07f1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:44.356007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19ca452d0bb47b792d706f87f0ba113', 'request_id': 'req-f1009801-cd45-439c-978b-19f1de0f07f1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:44.374908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19ca452d0bb47b792d706f87f0ba113', 'request_id': 'req-f1009801-cd45-439c-978b-19f1de0f07f1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:44.403758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] The token cache is being invalidate because project c19ca452d0bb47b792d706f87f0ba113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:44.404195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:44.405509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:44.407550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 901/1791] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:44 2022] DELETE /identity/v3/projects/c19ca452d0bb47b792d706f87f0ba113 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:44.413122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d982f1-959a-44b5-ba56-629d415981b2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.413674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d982f1-959a-44b5-ba56-629d415981b2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.413674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d982f1-959a-44b5-ba56-629d415981b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.462956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-69d982f1-959a-44b5-ba56-629d415981b2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:44.465336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-69d982f1-959a-44b5-ba56-629d415981b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.502966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:44.504978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.689401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 891/1792] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:44.691341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.691641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.691932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.729770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:44.730480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.749351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 892/1793] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:44.750302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:44.771306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e164c-c15e-4008-9990-1780251d268d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:44.778933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:44.780151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.780935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.781413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.782821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:44.788684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:44.791762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:44.800124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1009801-cd45-439c-978b-19f1de0f07f1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:44.820136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:44.821214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.824190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.825767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.828295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 893/1794] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:44.832932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:44.845386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:44.861717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:44.865035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:44.880320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 902/1795] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:44.884446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16513-9459-46d9-b0f7-c4cbe32a5cab admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:44.907988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:44.909066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:44.909588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:44.910096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:44.915275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:44.918149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:45.019156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 894/1796] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:44 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:45.023382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:45.042856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b0f49-0127-4131-9422-3eb521d56133 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:45.184940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:45.185652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:45.186593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:45.186593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:45.186909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:45.189627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:45.252197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 903/1797] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:45 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:45.256085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:45.277320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41bb09-16c0-4321-a9bd-2b0bdd40e8bc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:45.294613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:45.297518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:45.297809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:45.298091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:45.298864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:45.310375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:45.374026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:45.379556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:45.385832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 895/1798] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:45.396092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc96dd-f9bb-4e3f-8111-9401a65c8c56 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:45.416218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:45.417480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:45.417791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:45.418135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:45.418909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:45.420707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444366-dd85-48b1-bcc8-c80d7c2c4c21 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:45.475808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:45.490003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a2571-c05e-4070-8aac-14d15fcb1226 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:45.491809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 904/1799] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:45.513387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:45.514364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:45.514670 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:45.514934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] PATH_INFO: `/v3/projects/5ec690daffa44f01ac807bf13c6d184b/users/860151ea06764a4cb095f15296d0617b/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:45.583215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec690daffa44f01ac807bf13c6d184b, user_id=860151ea06764a4cb095f15296d0617b, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:45.597481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:45.658700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 896/1800] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:45 2022] PUT /identity/v3/projects/5ec690daffa44f01ac807bf13c6d184b/users/860151ea06764a4cb095f15296d0617b/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:45.669804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:45.669804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:45.670077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:45.739060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] MFA Rules not processed for user `860151ea06764a4cb095f15296d0617b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:45.740360 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:45.968693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:45.970562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 905/1801] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:45.974973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:46.151176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a03d-fe47-4216-87e4-1d2b51abd4d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.159665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:46.161103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:46.161627 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:46.162118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:46.163098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:46.166036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:46.235025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.237336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 897/1802] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:45 2022] POST /identity/v3/projects => generated 367 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:10:46.263902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99061abe-02b4-4cde-b7bf-7c6bd68448c7 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.306282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.313520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:46.403927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:46.404700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:46.404951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:46.405220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:46.405936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:46.407900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:46.452013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 906/1803] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:46 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:10:46.458793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.495094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba56f0-9cf6-4b68-a113-893e904135c8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.505149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:46.505828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:46.506091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:46.506371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:46.507116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:46.508769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:46.541854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 907/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:46.543325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.557770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:46.581634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3610bfc-9821-428c-991c-44f805213cd1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.582815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4af265-80bd-460c-aef7-567003f04693 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.608829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:46.611632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:46.611925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:46.612240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] PATH_INFO: `/v3/projects/2393cdf0911941a6b7fa7fcf35033640` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:46.616595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2393cdf0911941a6b7fa7fcf35033640)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:46.619160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:46.619898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:46.620875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:46.621167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:46.621451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] PATH_INFO: `/v3/projects/3dc9d573e30e475b8d117aca5fcd1f6a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:46.622870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc9d573e30e475b8d117aca5fcd1f6a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:46.624837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:46.725698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc9d573e30e475b8d117aca5fcd1f6a', 'request_id': 'req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.738960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:46.753111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc9d573e30e475b8d117aca5fcd1f6a', 'request_id': 'req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.757783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2393cdf0911941a6b7fa7fcf35033640', 'request_id': 'req-2bf5b705-b255-4fb8-b93c-81c548c1c340'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.761714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc9d573e30e475b8d117aca5fcd1f6a', 'request_id': 'req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.776216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2393cdf0911941a6b7fa7fcf35033640', 'request_id': 'req-2bf5b705-b255-4fb8-b93c-81c548c1c340'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.792262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] The token cache is being invalidate because project 3dc9d573e30e475b8d117aca5fcd1f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:46.792515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.793632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.795425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2393cdf0911941a6b7fa7fcf35033640', 'request_id': 'req-2bf5b705-b255-4fb8-b93c-81c548c1c340'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.795582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 908/1805] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:46 2022] DELETE /identity/v3/projects/3dc9d573e30e475b8d117aca5fcd1f6a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:46.796658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.798774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:46.822283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] The token cache is being invalidate because project 2393cdf0911941a6b7fa7fcf35033640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:46.822558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.825488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:46.828047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 898/1806] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:46 2022] DELETE /identity/v3/projects/2393cdf0911941a6b7fa7fcf35033640 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:46.828870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:46.833325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:46.880438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:46.953653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3b04-7973-410c-ac1c-b08dd9cb9ad1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:46.983842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b705-b255-4fb8-b93c-81c548c1c340 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:47.002817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:47.003779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.004071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.004336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] PATH_INFO: `/v3/users/7859ac7a2ec14f3e8e37843886592308` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.005658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7859ac7a2ec14f3e8e37843886592308)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:47.007626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:47.075267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:47.079527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.079980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.080486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] PATH_INFO: `/v3/projects/a37504efea5945ea84e1b696aefb2ed1/users/d8c5234976c6462d962e01609bb9cb7f/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.087283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7859ac7a2ec14f3e8e37843886592308'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.091322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7859ac7a2ec14f3e8e37843886592308'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.106560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7859ac7a2ec14f3e8e37843886592308'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.117036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37504efea5945ea84e1b696aefb2ed1, user_id=d8c5234976c6462d962e01609bb9cb7f, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:47.124034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7859ac7a2ec14f3e8e37843886592308'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.124684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7859ac7a2ec14f3e8e37843886592308'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.127409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:47.160900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 899/1807] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:46 2022] DELETE /identity/v3/users/7859ac7a2ec14f3e8e37843886592308 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:47.161858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:47.164752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:47.177161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 909/1808] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:46 2022] PUT /identity/v3/projects/a37504efea5945ea84e1b696aefb2ed1/users/d8c5234976c6462d962e01609bb9cb7f/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:47.180962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:47.197308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:47.368955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2e9f2-eef8-47f5-ad8c-197bae3d76e2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:47.397896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:47.398828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.399121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.399407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] PATH_INFO: `/v3/users/d393e85f8b5a4c78a85a04729f16821b` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.408195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d393e85f8b5a4c78a85a04729f16821b)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:47.411012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:47.441325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19a37-7d7e-4529-9672-21bd8d4e2de4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:47.472772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:47.473644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.474148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.474679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.475541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:47.477465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:47.507349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 910/1809] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:10:47.514041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:47.538395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26f19f-e26a-4355-95c3-d36d3a95c570 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:47.588123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:47.592488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.593101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.593768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] PATH_INFO: `/v3/projects/a37504efea5945ea84e1b696aefb2ed1/users/d8c5234976c6462d962e01609bb9cb7f/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.600743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37504efea5945ea84e1b696aefb2ed1, user_id=d8c5234976c6462d962e01609bb9cb7f, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:47.607581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:47.609671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922924b-0d27-4c19-bc37-32ef72578143 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:47.615273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd393e85f8b5a4c78a85a04729f16821b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.616829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd393e85f8b5a4c78a85a04729f16821b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.622658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:47.640993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd393e85f8b5a4c78a85a04729f16821b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.655201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd393e85f8b5a4c78a85a04729f16821b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.655906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd393e85f8b5a4c78a85a04729f16821b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:47.688027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 911/1810] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:47 2022] PUT /identity/v3/projects/a37504efea5945ea84e1b696aefb2ed1/users/d8c5234976c6462d962e01609bb9cb7f/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:47.693560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:47.694145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:47.694801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:47.718417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 900/1811] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:47 2022] DELETE /identity/v3/users/d393e85f8b5a4c78a85a04729f16821b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:47.775736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] MFA Rules not processed for user `d8c5234976c6462d962e01609bb9cb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:47.777746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:47.933401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 912/1812] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:47.957469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:47.959231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:48.102518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8850d7-f50e-4d8e-9b6a-fe138c98e9a9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:48.108265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:48.109470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:48.110038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:48.110571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:48.127495 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:48.129753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613128f9-3501-4269-b2c4-6da762deda0e service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:48.182493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 901/1813] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:48.266609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:48.309133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b04be-8d8e-4cc6-9782-fc19bfc3fe13 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:48.322011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:48.323469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:48.323919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:48.324879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:48.331272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:48.498990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:48.501029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d4c39-0791-40de-a709-c2e47c9faeba service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:48.544658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 913/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:49.449827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:49.450290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:49.452372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:49.456903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 902/1815] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:10:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:49.567430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5dfa3-e93b-4ac4-8fa2-01f48156bcde None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:49.568486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5dfa3-e93b-4ac4-8fa2-01f48156bcde None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:49.568855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5dfa3-e93b-4ac4-8fa2-01f48156bcde None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:49.570767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 914/1816] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:10:49.734621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:49.734918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:49.735206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:49.736914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:49.738676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:49.787110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:49.791612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:49.938651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b7fad-b5cb-49df-9abb-e386907fb8ec None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:49.956307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:49.957471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:49.957973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:49.958522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] PATH_INFO: `/v3/projects/95c29ecd39de492db7c539331aa3921b` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:49.961372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c29ecd39de492db7c539331aa3921b)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:49.966792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:50.069604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c29ecd39de492db7c539331aa3921b', 'request_id': 'req-9e308f7f-b063-44b4-8f01-b667bb921f9c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.076823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c29ecd39de492db7c539331aa3921b', 'request_id': 'req-9e308f7f-b063-44b4-8f01-b667bb921f9c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.081511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:50.094434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c29ecd39de492db7c539331aa3921b', 'request_id': 'req-9e308f7f-b063-44b4-8f01-b667bb921f9c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.112860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] The token cache is being invalidate because project 95c29ecd39de492db7c539331aa3921b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:50.113546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.114178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e308f7f-b063-44b4-8f01-b667bb921f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.116609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 903/1817] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:49 2022] DELETE /identity/v3/projects/95c29ecd39de492db7c539331aa3921b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:50.118548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:50.119126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:50.119484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:50.131561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 915/1818] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:50.134063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:50.136921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.171688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:50.173163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.191393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4abbd8-16a7-47f8-9332-ac86e0a3636d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:50.222805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:50.394688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:50.396197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:50.396197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:50.396197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] PATH_INFO: `/v3/users/13031f630cc24774a3c0a95cb6ba9f57` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:50.403023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13031f630cc24774a3c0a95cb6ba9f57)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:50.406896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:50.425760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 904/1819] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:50.426703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:50.430064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.461027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43a66-824b-4ab2-9be0-4ea7a5609f19 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:50.473353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:50.475001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:50.475543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:50.476235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] PATH_INFO: `/v3/users/7a11b4ca4b9a4d00af6ab48013f23a97` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:50.478223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a11b4ca4b9a4d00af6ab48013f23a97)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:50.489409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:50.506553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13031f630cc24774a3c0a95cb6ba9f57'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.515460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13031f630cc24774a3c0a95cb6ba9f57'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.516426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13031f630cc24774a3c0a95cb6ba9f57'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.528913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13031f630cc24774a3c0a95cb6ba9f57'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.530383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c6f926a0-353b-4dc9-a2e5-60df4d8e6fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13031f630cc24774a3c0a95cb6ba9f57'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.560009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 916/1820] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:50 2022] DELETE /identity/v3/users/13031f630cc24774a3c0a95cb6ba9f57 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:50.565504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:50.565905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:50.566348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:50.600256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a11b4ca4b9a4d00af6ab48013f23a97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.601653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:50.612299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a11b4ca4b9a4d00af6ab48013f23a97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.612423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.615753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a11b4ca4b9a4d00af6ab48013f23a97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.641417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a11b4ca4b9a4d00af6ab48013f23a97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.642151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a11b4ca4b9a4d00af6ab48013f23a97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:50.688457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 905/1821] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:50 2022] DELETE /identity/v3/users/7a11b4ca4b9a4d00af6ab48013f23a97 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:50.691378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 917/1822] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:50.764262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:50.766983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.874390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28b59-b70e-4fb9-843d-059aae71df21 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:50.884497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:50.886377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:50.889153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:50.889454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:50.920676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:50.921010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:50.922657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:50.989078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:51.060439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.062231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:51.088367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a248707-1cf8-4f10-833d-32606dbfcae3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:51.100932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 906/1823] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:51.213589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:51.215512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.216185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.216698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.221974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.240692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.240865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:51.242819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306d04-8d74-4945-917c-7d7e090f8469 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:51.242929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.281141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 918/1824] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:51.295313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c949-2b0f-4425-b2ec-bf3ffcbb4933 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:51.308294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:51.309253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.309585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.309907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] PATH_INFO: `/v3/projects/9a99923de4fe4faca0febe974526119f` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.311384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a99923de4fe4faca0febe974526119f)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.317774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:51.417012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a99923de4fe4faca0febe974526119f', 'request_id': 'req-6cb0109d-3d1a-418d-bfb2-57942445591d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:51.434042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a99923de4fe4faca0febe974526119f', 'request_id': 'req-6cb0109d-3d1a-418d-bfb2-57942445591d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:51.462339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a99923de4fe4faca0febe974526119f', 'request_id': 'req-6cb0109d-3d1a-418d-bfb2-57942445591d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:51.488829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] The token cache is being invalidate because project 9a99923de4fe4faca0febe974526119f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:51.489105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:51.489944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:51.497169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034934cc-9d88-4111-b7aa-14b30f30c6f9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.497530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034934cc-9d88-4111-b7aa-14b30f30c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.497824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034934cc-9d88-4111-b7aa-14b30f30c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.512948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 907/1825] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:51 2022] DELETE /identity/v3/projects/9a99923de4fe4faca0febe974526119f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:51.533186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-034934cc-9d88-4111-b7aa-14b30f30c6f9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:51.534450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-034934cc-9d88-4111-b7aa-14b30f30c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.665972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:51.668706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.694083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 919/1826] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:51.695582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.696787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.697322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.746119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:51.749271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.806160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 920/1827] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:51.809321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:51.839725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d792-e655-40d2-bf32-2f670e68ed47 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:51.854408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:51.856544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.857728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.858570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.860462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:51.861136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.867533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:51.905089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0109d-3d1a-418d-bfb2-57942445591d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:51.922892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 921/1828] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:51.924123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:51.925825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:51.926791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.927085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.927368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.937075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:51.967107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.967888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f223490-ee29-4a59-92e5-e62349889f50 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:51.971304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:51.990124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:51.990913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:51.991211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:51.991548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:51.994145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:51.998352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:52.001272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 908/1829] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:52.070775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 922/1830] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:51 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:52.071570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:52.093434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db108-8861-4dd1-a476-53088c8e3429 service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:52.121938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:52.315664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:52.316400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:52.316686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:52.316963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:52.317687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:52.319695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:52.382613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 909/1831] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:52 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:10:52.383941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:52.397658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f84e9-71d5-40d0-bfed-263cb14fd9f8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:52.421998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:52.422894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:52.425654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:52.425899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:52.426679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:52.435022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:52.475781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:52.482337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 923/1832] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:52.496216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f3b0e-93d3-42b7-9016-9645d82a5524 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:52.511499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:52.512127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:52.512418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:52.512701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:52.514062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:52.517433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4cff1-f898-432a-ad25-3cb195e5156a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:52.561980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 910/1833] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:10:52.562155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:52.571644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:52.583163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef200b-6a43-4ed7-a768-0e5f9fcbcb68 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:52.621359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:52.622289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:52.622753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:52.623051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] PATH_INFO: `/v3/projects/e37735983e104f9ebcfaab039cd17645/users/4d02ece32af44de5b90c4c8f7ee0ec65/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:52.674171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37735983e104f9ebcfaab039cd17645, user_id=4d02ece32af44de5b90c4c8f7ee0ec65, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:52.685502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:52.751482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 924/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:52 2022] PUT /identity/v3/projects/e37735983e104f9ebcfaab039cd17645/users/4d02ece32af44de5b90c4c8f7ee0ec65/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:52.752643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:52.752948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:52.753236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:52.924649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] MFA Rules not processed for user `4d02ece32af44de5b90c4c8f7ee0ec65`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:52.925449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:53.220689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 911/1835] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:53.231009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:53.403634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c681d-67b2-4464-bfe1-8ef00d54153a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:53.423052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:53.425452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:53.432005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:53.432005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:53.432005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:53.436672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:53.493222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 925/1836] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:53.497996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:53.537081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15e64a-f7c8-49ec-8ca9-5e251400032f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:53.636956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:53.639092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:53.664561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264537c4-df2b-484a-8942-d781710227be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:53.668756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264537c4-df2b-484a-8942-d781710227be admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:53.669475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264537c4-df2b-484a-8942-d781710227be admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:53.672795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264537c4-df2b-484a-8942-d781710227be admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:53.675295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264537c4-df2b-484a-8942-d781710227be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:53.684129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264537c4-df2b-484a-8942-d781710227be admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:53.774324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 912/1837] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:53 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:53.776806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264537c4-df2b-484a-8942-d781710227be admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:53.784983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbdb5-ca3e-4cda-8aae-941bbf15bd06 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:53.801718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:53.802663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:53.803012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:53.803404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] PATH_INFO: `/v3/users/860151ea06764a4cb095f15296d0617b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:53.814774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860151ea06764a4cb095f15296d0617b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:53.817071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:53.829909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264537c4-df2b-484a-8942-d781710227be admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:53.841991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:53.842694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:53.843294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:53.843294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:53.844576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:53.846386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:53.858843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:53.895840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 913/1838] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:53.896820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:53.909707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57411556-2cb7-47d5-a8ac-971a7d34ce4f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:53.910367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860151ea06764a4cb095f15296d0617b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:53.920102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:53.921218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:53.921626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:53.922009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] PATH_INFO: `/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e/users/089a1ff4763f46608af7ecba8d65d257/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:53.927310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860151ea06764a4cb095f15296d0617b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:53.936331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860151ea06764a4cb095f15296d0617b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:53.953447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860151ea06764a4cb095f15296d0617b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:53.954230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-107ed9f1-28b7-43a9-8db7-f1c0cf56dcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860151ea06764a4cb095f15296d0617b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:53.957312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:53.964770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d716d696d98b4baa8e48cd0f61fbcd4e, user_id=089a1ff4763f46608af7ecba8d65d257, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:53.973873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:54.003548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 914/1839] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:53 2022] PUT /identity/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e/users/089a1ff4763f46608af7ecba8d65d257/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:54.010835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.013861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.019729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 926/1840] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:53 2022] DELETE /identity/v3/users/860151ea06764a4cb095f15296d0617b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:10:54.024186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.024565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.024773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.085058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:54.086596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.136422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2d511-5a58-4250-88d8-c19f13fd7caf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:54.266440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 927/1841] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:54.283387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:54.286041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.286880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.287555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.289065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.290712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.292619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:54.294598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:54.322809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 915/1842] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:10:54.324858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.345144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03528d1-fc42-44c4-993d-2c484dc823b3 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:54.351848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:54.358173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.358922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.360665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] PATH_INFO: `/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e/users/089a1ff4763f46608af7ecba8d65d257/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.365215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d716d696d98b4baa8e48cd0f61fbcd4e, user_id=089a1ff4763f46608af7ecba8d65d257, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:54.376133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:54.457248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 916/1843] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:54 2022] PUT /identity/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e/users/089a1ff4763f46608af7ecba8d65d257/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:54.458321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.462334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68142fd8-31b8-4f8d-9ce0-44cde15fb462 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:54.467266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.597032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:54.597915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.598411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.598858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.679231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0155b3-43fb-4e13-9863-9305649abc8a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:54.694546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:54.695520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.696635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.696971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] PATH_INFO: `/v3/projects/384e43db976a495fb61920d89a07a938` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.697541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:54.704883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=384e43db976a495fb61920d89a07a938)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:54.711756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:54.718955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:54.720459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6ffa2-a615-410c-b871-854504987c02 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:54.734288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:54.755356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 928/1844] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:54.761443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:54.761870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:54.762261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:54.811009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] MFA Rules not processed for user `089a1ff4763f46608af7ecba8d65d257`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:54.812600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.826571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384e43db976a495fb61920d89a07a938', 'request_id': 'req-c80d69e4-4051-439c-83ca-b174c55c5dad'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:54.841270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384e43db976a495fb61920d89a07a938', 'request_id': 'req-c80d69e4-4051-439c-83ca-b174c55c5dad'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:54.859189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384e43db976a495fb61920d89a07a938', 'request_id': 'req-c80d69e4-4051-439c-83ca-b174c55c5dad'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:54.875337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] The token cache is being invalidate because project 384e43db976a495fb61920d89a07a938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:54.875644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:54.878654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:54.882190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 917/1845] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:54 2022] DELETE /identity/v3/projects/384e43db976a495fb61920d89a07a938 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:54.886101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.891067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:54.935408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 929/1846] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:54.947351 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:54.949931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.003181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d69e4-4051-439c-83ca-b174c55c5dad admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.013349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.014983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.016241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.016786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] PATH_INFO: `/v3/users/b8628b4b637140e88eff1e03883c7add` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.019163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8628b4b637140e88eff1e03883c7add)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.023883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.054595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075af931-dc16-4274-85b4-6ed8895a1072 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.060698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.061545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.061992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.062516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.076758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.078877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.093955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 930/1847] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:10:55.095488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.097647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.125577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697b21-f6b6-411f-a751-f6064f61e1d1 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.129319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8628b4b637140e88eff1e03883c7add'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.130638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.131208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8628b4b637140e88eff1e03883c7add'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.133146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.133431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.133735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] PATH_INFO: `/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.137956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] RBAC: Authorizing `identity:delete_project(project_id=782ea8be58ea4a5dacf76d0c76844a3a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.143295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.160432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8628b4b637140e88eff1e03883c7add'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.216884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8628b4b637140e88eff1e03883c7add'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.221601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8628b4b637140e88eff1e03883c7add'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.261252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782ea8be58ea4a5dacf76d0c76844a3a', 'request_id': 'req-bde84026-e11d-4bd3-b842-cb9052d5580a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.272080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 918/1848] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:54 2022] DELETE /identity/v3/users/b8628b4b637140e88eff1e03883c7add => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:55.274057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.276242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782ea8be58ea4a5dacf76d0c76844a3a', 'request_id': 'req-bde84026-e11d-4bd3-b842-cb9052d5580a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.277569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.288043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782ea8be58ea4a5dacf76d0c76844a3a', 'request_id': 'req-bde84026-e11d-4bd3-b842-cb9052d5580a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.298290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:55.303664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] The token cache is being invalidate because project 782ea8be58ea4a5dacf76d0c76844a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:55.304519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.305480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:55.306143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-bde84026-e11d-4bd3-b842-cb9052d5580a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.309579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 931/1849] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:55 2022] DELETE /identity/v3/projects/782ea8be58ea4a5dacf76d0c76844a3a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:55.317752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.318039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.318383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.356410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:55.357877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.379025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb889-d124-44e8-afd5-31fac34a946a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.390881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.392234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.392732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.393927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] PATH_INFO: `/v3/users/4d02ece32af44de5b90c4c8f7ee0ec65` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.396714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d02ece32af44de5b90c4c8f7ee0ec65)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.399610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.472616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 932/1850] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:55.473654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.477791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.491182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d02ece32af44de5b90c4c8f7ee0ec65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.513867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d02ece32af44de5b90c4c8f7ee0ec65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.519368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f955806-0b86-459a-a26d-d34145cd844e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.525671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d02ece32af44de5b90c4c8f7ee0ec65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.538046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d02ece32af44de5b90c4c8f7ee0ec65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.538806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9833a655-13cc-48be-bf57-0705802904c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d02ece32af44de5b90c4c8f7ee0ec65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.539011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.539978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.540268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.540547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] PATH_INFO: `/v3/projects/5ec690daffa44f01ac807bf13c6d184b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.548528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec690daffa44f01ac807bf13c6d184b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.551193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.565504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 919/1851] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:55 2022] DELETE /identity/v3/users/4d02ece32af44de5b90c4c8f7ee0ec65 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:55.567370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55e61-9e35-44b8-88a1-89d7481bdfef None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.568277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55e61-9e35-44b8-88a1-89d7481bdfef None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.568774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55e61-9e35-44b8-88a1-89d7481bdfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.600196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-82f55e61-9e35-44b8-88a1-89d7481bdfef None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:55.601986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-82f55e61-9e35-44b8-88a1-89d7481bdfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.693931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec690daffa44f01ac807bf13c6d184b', 'request_id': 'req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.708793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 920/1852] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:55.711108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.711668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.712125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.717523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec690daffa44f01ac807bf13c6d184b', 'request_id': 'req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.743010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec690daffa44f01ac807bf13c6d184b', 'request_id': 'req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.743766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:55.747108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.772759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] The token cache is being invalidate because project 5ec690daffa44f01ac807bf13c6d184b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:55.773043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.775282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.777469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 933/1853] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:55 2022] DELETE /identity/v3/projects/5ec690daffa44f01ac807bf13c6d184b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:55.782868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.786020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.805872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:55.850081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 921/1854] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:55.851446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.853833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.869237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea1e2-5a6f-44a9-b442-d2618dd8af9a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.871769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a430a4e-c985-4161-b603-eddb53936abe None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.877028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.877553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.877766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.878014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.878284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.879033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:55.879349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.879705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.880211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.880674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] PATH_INFO: `/v3/users/d8c5234976c6462d962e01609bb9cb7f` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.881657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.882573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c5234976c6462d962e01609bb9cb7f)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:55.885657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:55.897215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 934/1855] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:55.898089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.911680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.936211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:55.947652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c5234976c6462d962e01609bb9cb7f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.948518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c5234976c6462d962e01609bb9cb7f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.955855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c5234976c6462d962e01609bb9cb7f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.964248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c5234976c6462d962e01609bb9cb7f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.965034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c5234976c6462d962e01609bb9cb7f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:55.982116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c01a5a-c55d-435e-a05a-48ca1c980274 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:55.986025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:55.986704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:55.987001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:55.987280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:55.988786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 922/1856] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:55 2022] DELETE /identity/v3/users/d8c5234976c6462d962e01609bb9cb7f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:55.989782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:55.989910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:55.991223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:56.013444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.016329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.032681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 935/1857] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:56.086326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded58ed-efd8-4aac-96b1-a36d7575e305 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.094489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.096405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.096992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.097474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.098428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.102370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.156028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 923/1858] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:55 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:56.157650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.170587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184f74-6a0b-4a1a-bd20-101073efb992 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.289103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.289949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.290241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.290569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.291397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.294278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.340624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 936/1859] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:56 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:10:56.342006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.358772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fef95-5b8d-4429-925e-81c2dde1eed1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.376290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.377826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.378426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.378724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.379501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.381183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.403141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 924/1860] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:56.407894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.428471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c0f85-9acf-49a6-b552-c8ef24029cc7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.438533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.439094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.439920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.439920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.440471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.443596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82993f1f-ff58-4c4c-a4d5-c7cb09366def admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.462819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 937/1861] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:56.464733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.477724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662f209-4211-4c3d-9185-fdc63b0b78ef admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.497152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.498099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.498393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.499305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] PATH_INFO: `/v3/projects/eb73cff67bd044e389a7c2d0e811fb43/users/ac9ffda6a33a4e3eaab17789c1d9b60b/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.522411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb73cff67bd044e389a7c2d0e811fb43, user_id=ac9ffda6a33a4e3eaab17789c1d9b60b, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.526817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.537505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:56.548011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 925/1862] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:56 2022] PUT /identity/v3/projects/eb73cff67bd044e389a7c2d0e811fb43/users/ac9ffda6a33a4e3eaab17789c1d9b60b/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:56.557017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.557405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.559266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.592028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] MFA Rules not processed for user `ac9ffda6a33a4e3eaab17789c1d9b60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:56.593420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:56.681394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 938/1863] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:56.686435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.773553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520325f1-052e-43ce-8237-0aa6ae406cab admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.781891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.782943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.783533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.783925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.784940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.788125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.842368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.849403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 926/1864] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:56 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:56.861653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37467a36-8ec1-4f26-8ed6-0a19f8e0d303 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.887945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:56.889762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:56.929791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:56.983360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75fd80-96cc-4057-84e9-8c7c98e9360d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:56.989572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.990800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.990919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:56.991261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] PATH_INFO: `/v3/projects/39f516cf517e42578cd44b5db9f0e874` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:56.993146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f516cf517e42578cd44b5db9f0e874)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:56.996021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:56.996921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:56.997814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:56.998546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.000298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.001892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.009296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.053927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 939/1865] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:56 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:57.058591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.061483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.078903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99d40a-7802-4971-9f58-2403e9800dbe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.095417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f516cf517e42578cd44b5db9f0e874', 'request_id': 'req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.104704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f516cf517e42578cd44b5db9f0e874', 'request_id': 'req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.114785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f516cf517e42578cd44b5db9f0e874', 'request_id': 'req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.153035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] The token cache is being invalidate because project 39f516cf517e42578cd44b5db9f0e874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:57.153361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.154212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.158011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 927/1866] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:56 2022] DELETE /identity/v3/projects/39f516cf517e42578cd44b5db9f0e874 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.158906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.160323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.171566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.172581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.172878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.173163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] PATH_INFO: `/v3/projects/a37504efea5945ea84e1b696aefb2ed1` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.174422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37504efea5945ea84e1b696aefb2ed1)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.176555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.187393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:57.257185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37504efea5945ea84e1b696aefb2ed1', 'request_id': 'req-391b4711-e283-4aa3-814a-5a08c10b4927'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.270482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37504efea5945ea84e1b696aefb2ed1', 'request_id': 'req-391b4711-e283-4aa3-814a-5a08c10b4927'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.279192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37504efea5945ea84e1b696aefb2ed1', 'request_id': 'req-391b4711-e283-4aa3-814a-5a08c10b4927'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.285295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f4b0e-52d9-46cd-8902-1ee21381ab51 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.294427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] The token cache is being invalidate because project a37504efea5945ea84e1b696aefb2ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:57.294728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.305183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-391b4711-e283-4aa3-814a-5a08c10b4927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.311550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 940/1867] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:57 2022] DELETE /identity/v3/projects/a37504efea5945ea84e1b696aefb2ed1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.314540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abca75-c1e9-4cd5-a863-6ed33b4ff998 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.314836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abca75-c1e9-4cd5-a863-6ed33b4ff998 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.315120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abca75-c1e9-4cd5-a863-6ed33b4ff998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.339533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-27abca75-c1e9-4cd5-a863-6ed33b4ff998 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:57.341060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-27abca75-c1e9-4cd5-a863-6ed33b4ff998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.364915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.365607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.365914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.366196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.366935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.368567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.382210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 928/1868] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:57.382210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.382210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.394284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02fca1-4e54-4413-b03d-fa8553e1e23d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.395485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:57.399534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.400455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.400730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.401205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] PATH_INFO: `/v3/projects/e37735983e104f9ebcfaab039cd17645` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.407914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37735983e104f9ebcfaab039cd17645)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.410019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.412631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 941/1869] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:57.413913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598e74-5d53-4024-9573-4439e147262e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.414204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598e74-5d53-4024-9573-4439e147262e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.414482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598e74-5d53-4024-9573-4439e147262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.433099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2c598e74-5d53-4024-9573-4439e147262e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:57.434311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2c598e74-5d53-4024-9573-4439e147262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.442851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 942/1870] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:57.443410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c598e74-5d53-4024-9573-4439e147262e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.444637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2c598e74-5d53-4024-9573-4439e147262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.456563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c598e74-5d53-4024-9573-4439e147262e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.466960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37735983e104f9ebcfaab039cd17645', 'request_id': 'req-81857088-a55b-436b-95ca-411120ed9d97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.472616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37735983e104f9ebcfaab039cd17645', 'request_id': 'req-81857088-a55b-436b-95ca-411120ed9d97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.480506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37735983e104f9ebcfaab039cd17645', 'request_id': 'req-81857088-a55b-436b-95ca-411120ed9d97'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.493429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] The token cache is being invalidate because project e37735983e104f9ebcfaab039cd17645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:57.493719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.494393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-81857088-a55b-436b-95ca-411120ed9d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.496567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 929/1871] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:57 2022] DELETE /identity/v3/projects/e37735983e104f9ebcfaab039cd17645 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.497792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-21d4-46df-b945-ae735c0f7d64 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.498080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-21d4-46df-b945-ae735c0f7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.498361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e699eae-21d4-46df-b945-ae735c0f7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.515891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1e699eae-21d4-46df-b945-ae735c0f7d64 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:57.516408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.517135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1e699eae-21d4-46df-b945-ae735c0f7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.517728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.518188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.518635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] PATH_INFO: `/v3/projects/70ac3c79e2484ecbbe4ad996930949fb/users/8b2e94150a634483bb53c909c7602a93/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.525525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 930/1872] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:57.529724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.529989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.530273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.538835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ac3c79e2484ecbbe4ad996930949fb, user_id=8b2e94150a634483bb53c909c7602a93, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.542418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.550441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:57.551657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.559179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 943/1873] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:57 2022] PUT /identity/v3/projects/70ac3c79e2484ecbbe4ad996930949fb/users/8b2e94150a634483bb53c909c7602a93/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.560280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.562076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.589807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:57.626118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 931/1874] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:57.627051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.637671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb90a8-5e82-4771-aff4-11aabc08b372 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.642297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.643611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.643611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.643611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.644359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:57.644669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.646267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.649664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf106-570b-4b07-8334-e2f631f0b6f5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.655006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.656091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.656444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.656788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] PATH_INFO: `/v3/users/089a1ff4763f46608af7ecba8d65d257` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.658079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089a1ff4763f46608af7ecba8d65d257)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.659610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 932/1875] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:57.660487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.662922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.663662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.676095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ec14-5a57-44a3-a203-9bfc18c31aa7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.680904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.681569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.682546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.682546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.682883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.684504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.696767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 933/1876] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:57.698143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.708404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dbe2-7f53-429d-a03c-a523327539c3 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.713202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.714388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.714673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.714954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.715674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:57.716006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.717582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.721815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089a1ff4763f46608af7ecba8d65d257'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.730426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 934/1877] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:57.731325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.733587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089a1ff4763f46608af7ecba8d65d257'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.734365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089a1ff4763f46608af7ecba8d65d257'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.741632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e144d-05d0-49e8-adc9-35116eae6fdf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.743153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089a1ff4763f46608af7ecba8d65d257'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.744147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089a1ff4763f46608af7ecba8d65d257'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:57.746779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.747592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.748048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.748489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.749333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.749450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:57.751284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.766983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 944/1878] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:57 2022] DELETE /identity/v3/users/089a1ff4763f46608af7ecba8d65d257 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.767887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.769385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.789926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 935/1879] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/projects => generated 407 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:57.790834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.793209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.877736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bdc3c-8650-404b-8d56-96b050fa1a10 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.893382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b02666-4263-4e58-bcd7-29eb9bc448d0 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:57.899173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.900180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.900612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.901611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.902461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.904807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.943296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 936/1880] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:57.944296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:57.946622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:57.948290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:57.950376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:57.950865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:57.951330 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] PATH_INFO: `/v3/projects/70ac3c79e2484ecbbe4ad996930949fb/users/8b2e94150a634483bb53c909c7602a93/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:57.955012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ac3c79e2484ecbbe4ad996930949fb, user_id=8b2e94150a634483bb53c909c7602a93, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:57.960263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:57.985010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 945/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:57 2022] PUT /identity/v3/projects/70ac3c79e2484ecbbe4ad996930949fb/users/8b2e94150a634483bb53c909c7602a93/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:57.987539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.023295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b8a-2421-4220-a4ba-87bc5eea50fa admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.028275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:58.060894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109c5f2-8103-4082-9550-651ce2aceca7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.066036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.066911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.067339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.067814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.068696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.070762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490af6c-212d-4557-8b5c-806daa045731 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.090736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.091417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.091762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.092073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.092858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.095120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.095706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 946/1882] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:58.097162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.097457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.097745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.127063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] MFA Rules not processed for user `8b2e94150a634483bb53c909c7602a93`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:58.128519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 937/1883] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:57 2022] POST /identity/v3/users => generated 304 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:58.129161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.129438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.137454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:58.140582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b33da-4bdf-453d-a423-00d7b71c448b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.146315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.146904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.147194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.147475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.148241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.149835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.163547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 938/1884] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:58.163547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.163547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.176081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcca1f9-7eb7-4d4a-bb41-f4c14de9234d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.180708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.181556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.181838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.182117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] PATH_INFO: `/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.183364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d716d696d98b4baa8e48cd0f61fbcd4e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.185288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.210543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 947/1885] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:58.211479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.222671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9608b-a312-456a-86c3-d9876c1e02c3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.227405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.228102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.228392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.228669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.229427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.231017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.238333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd716d696d98b4baa8e48cd0f61fbcd4e', 'request_id': 'req-fc88ae99-d28d-4724-973e-56475520e1c1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:58.241366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 948/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:58.242162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.246747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd716d696d98b4baa8e48cd0f61fbcd4e', 'request_id': 'req-fc88ae99-d28d-4724-973e-56475520e1c1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:58.251872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc43fa-681a-4072-9a2b-e4e4300b6b42 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.254759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd716d696d98b4baa8e48cd0f61fbcd4e', 'request_id': 'req-fc88ae99-d28d-4724-973e-56475520e1c1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:58.267204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] The token cache is being invalidate because project d716d696d98b4baa8e48cd0f61fbcd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:10:58.267500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:58.268212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:58.269958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 939/1887] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:10:58 2022] DELETE /identity/v3/projects/d716d696d98b4baa8e48cd0f61fbcd4e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:58.270555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.271863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.310086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.310760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.311054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.311335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.312174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.313792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.325133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 949/1888] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:58.326042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.327711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.340934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4ad26-449f-48d3-8547-070dc9973372 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.343444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88ae99-d28d-4724-973e-56475520e1c1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.346350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.347018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.347309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.347599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.347973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.348370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.348663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.348950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.349234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.349962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cce6ad-9540-48e0-a48f-8ee5a0bf11e3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.352623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.373695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 950/1889] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:58.375211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.375652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.375945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.388055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:58.405795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:58.408742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.428108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 951/1890] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:58.429095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.436099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.449421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90914181-ab9b-4b13-b461-ba0e49ba596a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.454350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.455242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.455523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.455796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] PATH_INFO: `/v3/projects/6bf9d64514964b90abaae7ef19c95a81/users/d2ece3935c6e49fdbb813225205b11e2/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.461322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.463164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.473706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf9d64514964b90abaae7ef19c95a81, user_id=d2ece3935c6e49fdbb813225205b11e2, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.480109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 940/1891] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:58.480430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bdf86-9263-46c8-89a6-ef3bb29ba72e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.480945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.492027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab9296-44fe-4548-be4f-7fe6f1dc588e service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.511324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 952/1892] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:58 2022] PUT /identity/v3/projects/6bf9d64514964b90abaae7ef19c95a81/users/d2ece3935c6e49fdbb813225205b11e2/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:58.512803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebd22-0656-4ad9-8cc7-df5dc8ce207e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.513764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebd22-0656-4ad9-8cc7-df5dc8ce207e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.514047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebd22-0656-4ad9-8cc7-df5dc8ce207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.549305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-39eebd22-0656-4ad9-8cc7-df5dc8ce207e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:58.550564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-39eebd22-0656-4ad9-8cc7-df5dc8ce207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.578880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.580060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.580450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.580873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] PATH_INFO: `/v3/projects/0af27b7f06f74d5d8487f81b931f05f9/users/415e994a56914028b2b16cc83ae5ed99/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.602060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af27b7f06f74d5d8487f81b931f05f9, user_id=415e994a56914028b2b16cc83ae5ed99, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.608528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dc40b-d8d2-480d-8437-04fc60dc6774 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.621956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 941/1893] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:58 2022] PUT /identity/v3/projects/0af27b7f06f74d5d8487f81b931f05f9/users/415e994a56914028b2b16cc83ae5ed99/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:58.623253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.623539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.623819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.624362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:58.647578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 953/1894] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:58.648929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.649352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.649642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.658775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] MFA Rules not processed for user `d2ece3935c6e49fdbb813225205b11e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:58.660283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.677830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] MFA Rules not processed for user `415e994a56914028b2b16cc83ae5ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:58.679678 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:58.753930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 942/1895] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:58.753930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.761028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 954/1896] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:58.761889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.799557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:58.837809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed01207-33fc-4314-bb79-1fc6e759ecd7 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.842982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.843853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.844244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.844602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.845424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:10:58.845812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.847506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.852965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a35625-a4fb-4fdc-8736-c7a7d620a564 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.860467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.861575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 943/1897] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:10:58.862009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.862474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.862578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.863159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.864242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.866911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.874872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd6d3-cb0f-4a83-85ce-c413d5c8ffe5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:58.881482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:58.882148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:58.882444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:58.882829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:58.883591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:58.885778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:58.908133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 955/1898] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:58.908133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.923939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 944/1899] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/projects => generated 409 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:58.925207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:58.993409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927d6e2-4214-4a2e-baf1-facdd5f95700 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.006140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.006680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.006968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.007253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.009219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.011201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.025810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740732-e21f-4ba6-a67a-42947494e91a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.043335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 945/1900] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:59.043335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.052296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0176-7dda-45a7-8391-953109e337dc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.052963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.054750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.055189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.055594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.056461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.059035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.062680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:59.064968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.065728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.066195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.066485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.067209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.069174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.103304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 946/1901] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:59 2022] POST /identity/v3/users => generated 311 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:59.103304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.112094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 956/1902] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:10:58 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:59.112714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5e16f-4c71-41dc-b1a2-02c8e2ff87d6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.113123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.188724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186b75-e24f-4c10-a150-1ab547ecc3f1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.188840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.189536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.189810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.190087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.192216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.194073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.196074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.196707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.197656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.197980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.198790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.200440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.208104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 947/1903] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.208104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.213080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 957/1904] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.214748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.218152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.219259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef06e9-d39d-4d7a-9bc2-2dadc39998b6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.223721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.224450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.224737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.225015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.225700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.227631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.231760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dac73-f39b-49aa-8b05-4e238123003a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.236198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.237067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.237352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.237588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:59.237706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] PATH_INFO: `/v3/users/ac9ffda6a33a4e3eaab17789c1d9b60b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.238832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9ffda6a33a4e3eaab17789c1d9b60b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.240778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.251623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 948/1905] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:10:59 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:10:59.252681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.262275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5ac79-e66e-4e1c-abb1-c67baf3e8b52 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.267098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.268156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.268492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.268806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] PATH_INFO: `/v3/projects/be24806334ea4c11b27a82889bc859d5/users/69a73da6800845eb965c5a57599ac763/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.285225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] RBAC: Authorizing `identity:create_grant(project_id=be24806334ea4c11b27a82889bc859d5, user_id=69a73da6800845eb965c5a57599ac763, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.287910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.292688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9ffda6a33a4e3eaab17789c1d9b60b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:59.299870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9ffda6a33a4e3eaab17789c1d9b60b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:59.300669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9ffda6a33a4e3eaab17789c1d9b60b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:59.301006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 949/1906] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:59 2022] PUT /identity/v3/projects/be24806334ea4c11b27a82889bc859d5/users/69a73da6800845eb965c5a57599ac763/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.301775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.308369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9ffda6a33a4e3eaab17789c1d9b60b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:59.309017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9ffda6a33a4e3eaab17789c1d9b60b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:10:59.328016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 958/1907] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:10:59 2022] DELETE /identity/v3/users/ac9ffda6a33a4e3eaab17789c1d9b60b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.330995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.330995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.365410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f93dc-920e-4269-9ccd-5d76fe0668df admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.383603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:59.399255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30097d75-557d-4eda-87dc-b2239372485a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.405260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.405946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.407062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.407062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.407429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.409137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.423267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 959/1908] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.423267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.423267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.429282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.430325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.430437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.430719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] PATH_INFO: `/v3/projects/ff04824d29bd4fedb88083c0537b3925/users/1a0b7cff53f14016836ee60fc6197e82/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.439201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405cf6-6797-4e0f-abde-c4e4140a507e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.443909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.444608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.444896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.445179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.445909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.447775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6807da-1f71-495e-837c-e08177387b16 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.448468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff04824d29bd4fedb88083c0537b3925, user_id=1a0b7cff53f14016836ee60fc6197e82, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.451113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.460293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 960/1909] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.460293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.460293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.460293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.467715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 950/1910] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:59 2022] PUT /identity/v3/projects/ff04824d29bd4fedb88083c0537b3925/users/1a0b7cff53f14016836ee60fc6197e82/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.468413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.484183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:59.485419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.543027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48abe-03a9-4457-b73a-c85eb8a9a731 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.552220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.552903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.553187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.553466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.554205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.556088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.558149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:59.569892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 951/1911] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.570780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.577757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 961/1912] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:59.578697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.580234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.590404 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c862d2-aed4-4a2a-9d2a-1c33c8ee140b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.599685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.601168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.601456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.601813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] PATH_INFO: `/v3/projects/be24806334ea4c11b27a82889bc859d5/users/69a73da6800845eb965c5a57599ac763/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.603570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045555e-70ac-4690-816f-fc7732d54245 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.607364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=be24806334ea4c11b27a82889bc859d5, user_id=69a73da6800845eb965c5a57599ac763, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.611106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.615699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.617667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.619099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.619907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.622600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 952/1913] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:59 2022] PUT /identity/v3/projects/be24806334ea4c11b27a82889bc859d5/users/69a73da6800845eb965c5a57599ac763/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.622837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.623746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.628304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.644135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 962/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:10:59.645099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.649765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.712250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e7e72-60d3-469d-894a-4f5218fd4dca admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.718700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.719610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.720084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.720371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] PATH_INFO: `/v3/projects/69d021ba3f2f4ab7ba2fafa267385c86/users/a805f07722794a05bf9c549cc3d8e022/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.737054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d021ba3f2f4ab7ba2fafa267385c86, user_id=a805f07722794a05bf9c549cc3d8e022, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.740281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7b0ee-4b7e-4f01-9a29-fac308b97b70 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.742460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed5dd-b45c-40d2-8070-7705beaf83b2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.770247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 953/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:59 2022] PUT /identity/v3/projects/69d021ba3f2f4ab7ba2fafa267385c86/users/a805f07722794a05bf9c549cc3d8e022/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.772132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada4f4-92b8-4303-8fe3-c6ea6f516b70 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.772361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada4f4-92b8-4303-8fe3-c6ea6f516b70 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.772645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada4f4-92b8-4303-8fe3-c6ea6f516b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.800888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.801812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.802246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.802696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.805051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-11ada4f4-92b8-4303-8fe3-c6ea6f516b70 None None] MFA Rules not processed for user `69a73da6800845eb965c5a57599ac763`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:59.806380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-11ada4f4-92b8-4303-8fe3-c6ea6f516b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.813856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.815754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.835744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 963/1916] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:10:59.837112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.848643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd17e8-a98c-438e-ac5b-2b1176ddab05 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:10:59.874283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:10:59.910033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 954/1917] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:10:59.915444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f404-02fc-4355-9aee-1c9199b8689d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.915756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f404-02fc-4355-9aee-1c9199b8689d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.916048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f404-02fc-4355-9aee-1c9199b8689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.918474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:10:59.919856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:10:59.920385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:10:59.920866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] PATH_INFO: `/v3/projects/ff04824d29bd4fedb88083c0537b3925/users/1a0b7cff53f14016836ee60fc6197e82/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:10:59.926643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff04824d29bd4fedb88083c0537b3925, user_id=1a0b7cff53f14016836ee60fc6197e82, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:10:59.930396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:10:59.960793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 964/1918] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:10:59 2022] PUT /identity/v3/projects/ff04824d29bd4fedb88083c0537b3925/users/1a0b7cff53f14016836ee60fc6197e82/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:10:59.961949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ec70f404-02fc-4355-9aee-1c9199b8689d None None] MFA Rules not processed for user `a805f07722794a05bf9c549cc3d8e022`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:10:59.963331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:10:59.964457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ec70f404-02fc-4355-9aee-1c9199b8689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:10:59.965266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.031159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:00.055173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd24f0-8eb3-4c57-bf9a-de70640d86e3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.059988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.060631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.060972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.061249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.067380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 955/1919] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:00.069616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.070124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.070745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.103793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] MFA Rules not processed for user `1a0b7cff53f14016836ee60fc6197e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:00.106781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.152965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.155781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.168502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 965/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:10:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:00.169517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.214989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 956/1921] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:00.220922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.224069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.256433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e65e-247c-438e-8f57-ce1e87f59b8b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.262110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.262785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.263074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.263360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.275387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.275667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74475dd7-7ef2-4899-b38e-f43a238fc385 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.278035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.281102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.281777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.282063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.282345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.283052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.285063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.289932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 957/1922] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:00.290863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.315237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:00.317605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098cc45-3660-4068-8a90-0511461beda0 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.331037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.331916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.332514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.332941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.335327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.338463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 966/1923] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:00 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:00.339698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.345279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.415262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.417339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.425847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7973c1-8d71-4795-9551-56a3742d2144 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.426645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 958/1924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:00.427702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.435625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.436512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.436801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.437084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] PATH_INFO: `/v3/projects/eb73cff67bd044e389a7c2d0e811fb43` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.441056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb73cff67bd044e389a7c2d0e811fb43)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.443530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.445659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fff6-5c82-4f7f-8a10-f93d0ad48fac service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.452032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.452911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.453343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.453765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.454791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.458246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.486522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 959/1925] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:00 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:00.491073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.502967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264457b-59ea-43f8-88da-330aa8ba1f8f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.525627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb73cff67bd044e389a7c2d0e811fb43', 'request_id': 'req-410cab94-cad0-4549-8f71-abf564e94796'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.539254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb73cff67bd044e389a7c2d0e811fb43', 'request_id': 'req-410cab94-cad0-4549-8f71-abf564e94796'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.544334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:00.548889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb73cff67bd044e389a7c2d0e811fb43', 'request_id': 'req-410cab94-cad0-4549-8f71-abf564e94796'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.561306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] The token cache is being invalidate because project eb73cff67bd044e389a7c2d0e811fb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:00.561685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.562746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.564230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 967/1926] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:00 2022] DELETE /identity/v3/projects/eb73cff67bd044e389a7c2d0e811fb43 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:00.567759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.569262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.575161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.575842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.576160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.576441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.577237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.578855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.593753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 960/1927] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:00.598355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.602385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.616069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a0c2a-a69a-4ee2-b6f0-7c44c89831da admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.621604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.622585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.622941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.623295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] PATH_INFO: `/v3/users/8b2e94150a634483bb53c909c7602a93` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.624606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2e94150a634483bb53c909c7602a93)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.626547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.646938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cab94-cad0-4549-8f71-abf564e94796 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.650260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.651582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.651877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.652268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.654203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.685980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2e94150a634483bb53c909c7602a93'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.686661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2e94150a634483bb53c909c7602a93'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.699747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2e94150a634483bb53c909c7602a93'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.700750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:00.708556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2e94150a634483bb53c909c7602a93'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.709442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2e94150a634483bb53c909c7602a93'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:00.732825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.735570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.740533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 961/1928] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:00 2022] DELETE /identity/v3/users/8b2e94150a634483bb53c909c7602a93 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:00.741402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.742766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.765664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 968/1929] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:00.841545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babe6d-e080-4597-9aea-7fa6a0bd99cf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.848269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.849099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.849395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.850190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.851004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.853064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad2d90-d737-45a7-9881-3e2edf83423e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.869621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 962/1930] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:00.873853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:00.875457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:00.904526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ad7-f030-4884-9305-cd0f92f5e1d8 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:00.912772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:00.913882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:00.914231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:00.914834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] PATH_INFO: `/v3/projects/afa9d01cd7ee41c3a47e4a5d102ba094/users/fce9c471309f477994ec17a5d958437b/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:00.949667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa9d01cd7ee41c3a47e4a5d102ba094, user_id=fce9c471309f477994ec17a5d958437b, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:00.952463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:00.991835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 969/1931] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:00 2022] PUT /identity/v3/projects/afa9d01cd7ee41c3a47e4a5d102ba094/users/fce9c471309f477994ec17a5d958437b/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:01.001961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.002252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.002554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.088132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] MFA Rules not processed for user `fce9c471309f477994ec17a5d958437b`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:01.090287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:01.142640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:01.217337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 963/1932] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:01.221459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.308604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2415c-504d-438e-ad36-2438a9ffe88b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.317976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.318763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.318970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.319258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.320012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.323393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.360641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 970/1933] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:01.365636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.380193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbc066-df3f-488c-b5d4-826dcec1c9b4 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.479338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.480073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.481059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.481182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.481885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.484176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.526218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 964/1934] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:01.527616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.545894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae794f2-a2bb-4ce3-9b92-acc2aecb9da1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.552632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.553362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.553729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.554066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.554855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.556758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.564984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.569387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:01.575481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 971/1935] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:01.582067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.604986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142db0-a1fb-4cb9-9a28-0a307846d809 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.607771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178206-cb63-4e49-90d1-4441c649423f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.612568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.612890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.613698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.613798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.614059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.614155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.614363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] PATH_INFO: `/v3/projects/b1425838f96e498494616a8699f8e643/users/68485dfac0ac431187da8d3f84b70ad3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.614466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] PATH_INFO: `/v3/projects/70ac3c79e2484ecbbe4ad996930949fb` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.615702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ac3c79e2484ecbbe4ad996930949fb)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.618058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.637154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1425838f96e498494616a8699f8e643, user_id=68485dfac0ac431187da8d3f84b70ad3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.640479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.657683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 972/1936] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:01 2022] PUT /identity/v3/projects/b1425838f96e498494616a8699f8e643/users/68485dfac0ac431187da8d3f84b70ad3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:01.661866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.691246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ac3c79e2484ecbbe4ad996930949fb', 'request_id': 'req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:01.699753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ac3c79e2484ecbbe4ad996930949fb', 'request_id': 'req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:01.712542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ac3c79e2484ecbbe4ad996930949fb', 'request_id': 'req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:01.726591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] The token cache is being invalidate because project 70ac3c79e2484ecbbe4ad996930949fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:01.726901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:01.729940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-cb6b2f7f-1a02-4950-bd10-fa1b4bfd0af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:01.732396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 965/1937] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:01 2022] DELETE /identity/v3/projects/70ac3c79e2484ecbbe4ad996930949fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:01.737889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead87f3-67e3-4e1a-aca6-29d5a3f1ed5d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.738266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead87f3-67e3-4e1a-aca6-29d5a3f1ed5d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.738785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead87f3-67e3-4e1a-aca6-29d5a3f1ed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.753203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25aac9-4708-447c-b4be-363f8bdf6020 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.762866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-cead87f3-67e3-4e1a-aca6-29d5a3f1ed5d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:01.764221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cead87f3-67e3-4e1a-aca6-29d5a3f1ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:01.767149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:01.804402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:01.841790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.843014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.843497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.843920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.844903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.847100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.852259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 966/1938] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:01.859244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.859531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.860216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.868400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 973/1939] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:01.877093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.880258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:01.896401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3d2c-9b23-4e47-90f7-bfbea4c1c5a1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.898963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:01.901466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:01.902225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:01.903398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.903783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.904200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] PATH_INFO: `/v3/projects/b1425838f96e498494616a8699f8e643/users/68485dfac0ac431187da8d3f84b70ad3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.907673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1425838f96e498494616a8699f8e643, user_id=68485dfac0ac431187da8d3f84b70ad3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:01.910562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f1fdf-76c1-42e1-b202-5b4a64160d4b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:01.916069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 967/1940] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:01.924096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:01.930827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 974/1941] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:01 2022] PUT /identity/v3/projects/b1425838f96e498494616a8699f8e643/users/68485dfac0ac431187da8d3f84b70ad3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:01.934679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113c77a-0d98-4403-bf88-13af3799ef46 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:01.943174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:01.943802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:01.944292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:01.983828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] MFA Rules not processed for user `68485dfac0ac431187da8d3f84b70ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:01.985382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:02.014070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.015172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.015458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.015739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.016695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:02.017015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.019300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.040517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 968/1942] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:02.046347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.061266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29c70-b576-43a4-a621-0b93e977dafa admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.067288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.069922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.070215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.070500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.072399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.075087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.117555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 975/1943] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:02.120751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 969/1944] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:02 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:02.124657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.126415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.128453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:02.137797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d472b-7159-459a-9024-d2fded0ce849 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.211776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.212345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.212636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.213056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.214458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.216440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.234998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608ece7-4bcd-42ed-aba5-314600caf1a1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.240577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.241413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.241852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.242133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.243310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 976/1945] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:02 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:02.247024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.258800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f6a08-3eea-4a38-8a04-5faa1bbd558c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.264692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.265586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.265979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.266348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.267217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.269053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.275537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:02.281899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 977/1946] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:02.287530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.299536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d18440-b325-4b95-a45b-d98ab8aa0e4e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.304578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.305255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.305669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.305963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.306704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.308402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.326784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 978/1947] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:02.328316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.329247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:02.332414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.334388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db15315-6a15-4399-8323-de2d57fb8b1f service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.341347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afe61a-8f1f-4069-baad-f1c0e161b131 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.346495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.347386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.347672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.347980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] PATH_INFO: `/v3/projects/75bcc63845fc4c659b3b6725a70924cd/users/d7ba3fa4616f48b9aa3a0cdcf9ad698a/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.349185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 970/1948] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:02.365757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bcc63845fc4c659b3b6725a70924cd, user_id=d7ba3fa4616f48b9aa3a0cdcf9ad698a, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.368592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.391538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 979/1949] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:02 2022] PUT /identity/v3/projects/75bcc63845fc4c659b3b6725a70924cd/users/d7ba3fa4616f48b9aa3a0cdcf9ad698a/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:02.395198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.395400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.396662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.437070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] MFA Rules not processed for user `d7ba3fa4616f48b9aa3a0cdcf9ad698a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:02.438411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:02.531469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 971/1950] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:02.700800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.796811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04704-bb33-4e60-96ac-adeacfc3c572 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:02.800958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:02.801752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:02.802217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:02.802665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:02.825125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:02.826691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6fb20-5f75-4302-9ee9-9b930f8b54a0 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:02.839270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 980/1951] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:02.861506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:02.987537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bfbab-10e5-4c7b-bbcd-c4f24d498e59 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:03.001210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:03.002072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.002364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.002648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] PATH_INFO: `/v3/users/d7ba3fa4616f48b9aa3a0cdcf9ad698a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.005878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ba3fa4616f48b9aa3a0cdcf9ad698a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:03.007821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:03.097879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ba3fa4616f48b9aa3a0cdcf9ad698a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.098765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ba3fa4616f48b9aa3a0cdcf9ad698a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.109756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ba3fa4616f48b9aa3a0cdcf9ad698a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.122733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ba3fa4616f48b9aa3a0cdcf9ad698a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.123846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37561d81-eaa1-480a-92bc-6efd1278b5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ba3fa4616f48b9aa3a0cdcf9ad698a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.150865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 972/1952] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:02 2022] DELETE /identity/v3/users/d7ba3fa4616f48b9aa3a0cdcf9ad698a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:03.155892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.156075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.156390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.177054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:03.178086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.255015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80319-9bb6-4f1d-93ff-d605da7cd27c None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.255996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80319-9bb6-4f1d-93ff-d605da7cd27c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.256458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80319-9bb6-4f1d-93ff-d605da7cd27c None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.257766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 973/1953] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:11:03.269426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.269830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.270462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.291191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:03.292183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 981/1954] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:03.311535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:03.313523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.329127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:03.330399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.397654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b1d4-570f-4631-9c63-45807867615e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:03.402994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:03.403688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.404022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.404338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.414960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:03.416517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:03.427231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 982/1955] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:03.427983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:03.429431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.440107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 974/1956] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:03.446636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:03.460943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:03.462380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.478611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e8f01-0dca-4970-9ee9-801825b0d5fa None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:03.484488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:03.485739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.486029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.486329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.497051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:03.500325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:03.501839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ceb03-504c-40a2-ac2f-a25c0c3efaa3 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:03.507666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:03.508387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.508674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.508952 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.511488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.514674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 975/1957] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:03.597083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:03.598888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca6175-bbe7-4b77-a889-2a4f2ee4ee3f service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:03.609336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 983/1958] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:03.779623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:03.783769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:03.841974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021df-dba3-4d24-92a9-fd3ea8b738f5 service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:03.848904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:03.850124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.850751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.851353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] PATH_INFO: `/v3/projects/75bcc63845fc4c659b3b6725a70924cd` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:03.852830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bcc63845fc4c659b3b6725a70924cd)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:03.855769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:03.947526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bcc63845fc4c659b3b6725a70924cd', 'request_id': 'req-d39cd46f-c001-46c5-b8f8-34c423956aa4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.955230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bcc63845fc4c659b3b6725a70924cd', 'request_id': 'req-d39cd46f-c001-46c5-b8f8-34c423956aa4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.964357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bcc63845fc4c659b3b6725a70924cd', 'request_id': 'req-d39cd46f-c001-46c5-b8f8-34c423956aa4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.978202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] The token cache is being invalidate because project 75bcc63845fc4c659b3b6725a70924cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:03.978492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.979701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d39cd46f-c001-46c5-b8f8-34c423956aa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:03.985438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 976/1959] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:03 2022] DELETE /identity/v3/projects/75bcc63845fc4c659b3b6725a70924cd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:03.986514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:03.986809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:03.987089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.005706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:04.006999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:04.071940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 984/1960] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:04.080610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.080809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.081110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.100448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:04.101669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:04.109889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 977/1961] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:04.114166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.124361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1884a-3679-42b1-9970-d931aff49f94 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.130028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.131112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.131520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.131679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.134712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:04.135034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.137306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.150422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 985/1962] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:04.155006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.165517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2d61d-b52c-4e2c-b796-5bd2541717d2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.170828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.171643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.172079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.172535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.173515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.175541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.214969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 978/1963] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:04 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:04.218869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.233005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1941d90-11a8-4453-b9d1-03159d8ca548 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.324163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:04.336475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.337404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.337698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.337983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.339527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.342027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.376185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 986/1964] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:04 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:04.377578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.390712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802067b-d309-4e2f-a4f0-12fa1d45bcd6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.397059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.397936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.398256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.398596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.399526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.401802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.428010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 979/1965] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:04.429248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.441105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346e9e-3fcf-44c1-aefd-965b468520f8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.449388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.450503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.450503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.450697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.451405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.453342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c73c5-0f63-46bd-a342-77673b86dd95 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.474797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 987/1966] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:04.478665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.491555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5688d-927b-4062-932b-08d912bface6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.499386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.500824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.501329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.503272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] PATH_INFO: `/v3/projects/60d5d7538f64423da194da83e9093c49/users/18ed4823c8df46e5b003be60542d3e41/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.534188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d5d7538f64423da194da83e9093c49, user_id=18ed4823c8df46e5b003be60542d3e41, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.537261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.555884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 980/1967] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:04 2022] PUT /identity/v3/projects/60d5d7538f64423da194da83e9093c49/users/18ed4823c8df46e5b003be60542d3e41/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:04.574066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.574879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.575478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.625554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] MFA Rules not processed for user `18ed4823c8df46e5b003be60542d3e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:04.627358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:04.680133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.681852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:04.687716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:04.720242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 988/1968] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:04.733519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.736202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:04.779103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45afe-8f70-4b57-a284-dfbf30bc48a2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.785501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.786485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.786836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.787189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] PATH_INFO: `/v3/users/d2ece3935c6e49fdbb813225205b11e2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.788602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ece3935c6e49fdbb813225205b11e2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.792162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.818647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058633-dd59-40a0-be0b-5faee35302c5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.825212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.825920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.826270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.826639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.837128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.838910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.850016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 989/1969] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:04.875489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:04.876446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ece3935c6e49fdbb813225205b11e2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:04.877267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ece3935c6e49fdbb813225205b11e2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:04.889415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ece3935c6e49fdbb813225205b11e2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:04.890123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac626f2-31b5-4e0b-aef5-6d2c7df244d4 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:04.896862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:04.897903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.898256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.898639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] PATH_INFO: `/v3/users/18ed4823c8df46e5b003be60542d3e41` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.898758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ece3935c6e49fdbb813225205b11e2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:04.899391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ca5771d1-ebf8-485a-bcfc-dcbcf58bf8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ece3935c6e49fdbb813225205b11e2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:04.900896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ed4823c8df46e5b003be60542d3e41)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:04.902727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:04.935758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 981/1970] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:04 2022] DELETE /identity/v3/users/d2ece3935c6e49fdbb813225205b11e2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:04.942876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:04.943908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:04.944297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:04.988305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:04.992058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.008692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ed4823c8df46e5b003be60542d3e41'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:05.026261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ed4823c8df46e5b003be60542d3e41'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:05.027528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ed4823c8df46e5b003be60542d3e41'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:05.032557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:05.058894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ed4823c8df46e5b003be60542d3e41'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:05.061076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-57372a43-5124-4623-866a-bf88166f10fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ed4823c8df46e5b003be60542d3e41'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:05.116842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 990/1971] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:04 2022] DELETE /identity/v3/users/18ed4823c8df46e5b003be60542d3e41 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:05.123546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:05.123843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:05.126725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:05.185387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 982/1972] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:05.191229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:05.193692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.200084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:05.201802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.298352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:05.304874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 991/1973] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:05.355745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:05.358742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.380722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ac73-fd5a-4909-9888-a9dbd804dbe9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:05.430382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e146-1622-4d8f-b708-2558752036ad None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:05.435046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:05.435673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:05.435979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:05.436810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:05.454516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:05.455903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:05.460955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:05.462387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:05.462504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:05.462705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:05.471325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 992/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:05.474653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:05.476164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:05.487709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 983/1975] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:05.919491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:05.922804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:05.923287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.924390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:05.940023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5e284-59e9-4c36-8d01-d31868cb63f1 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:05.943042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135e3d-9ef4-4301-bcc8-30e220d23d4c service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:05.946210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:05.947081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:05.948723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:05.949164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:05.949310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] PATH_INFO: `/v3/projects/6bf9d64514964b90abaae7ef19c95a81` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:05.950286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:05.950708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf9d64514964b90abaae7ef19c95a81)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:05.950820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:05.951452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] PATH_INFO: `/v3/projects/60d5d7538f64423da194da83e9093c49` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:05.953259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:05.953770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d5d7538f64423da194da83e9093c49)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:05.956041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.008458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d5d7538f64423da194da83e9093c49', 'request_id': 'req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.011474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf9d64514964b90abaae7ef19c95a81', 'request_id': 'req-e29e334e-e4ff-4751-8395-addc35dfc6df'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.016521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d5d7538f64423da194da83e9093c49', 'request_id': 'req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.020199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf9d64514964b90abaae7ef19c95a81', 'request_id': 'req-e29e334e-e4ff-4751-8395-addc35dfc6df'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.024783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d5d7538f64423da194da83e9093c49', 'request_id': 'req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.026592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf9d64514964b90abaae7ef19c95a81', 'request_id': 'req-e29e334e-e4ff-4751-8395-addc35dfc6df'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.036538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] The token cache is being invalidate because project 60d5d7538f64423da194da83e9093c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:06.036916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.037646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-8aebb8de-0f7c-4bc9-9194-e9cf5463605b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.037996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] The token cache is being invalidate because project 6bf9d64514964b90abaae7ef19c95a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:06.038285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.038932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.039309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 984/1976] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:05 2022] DELETE /identity/v3/projects/60d5d7538f64423da194da83e9093c49 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:06.040704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 993/1977] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:05 2022] DELETE /identity/v3/projects/6bf9d64514964b90abaae7ef19c95a81 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:06.044176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bf6e-5aa0-4e24-bcba-0e7a74278755 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.044465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bf6e-5aa0-4e24-bcba-0e7a74278755 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.044591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.044744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bf6e-5aa0-4e24-bcba-0e7a74278755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.045898 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.050857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:06.064605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f652bf6e-5aa0-4e24-bcba-0e7a74278755 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:06.065806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f652bf6e-5aa0-4e24-bcba-0e7a74278755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.113983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e334e-e4ff-4751-8395-addc35dfc6df admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.118695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.120140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.120545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.120832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] PATH_INFO: `/v3/users/69a73da6800845eb965c5a57599ac763` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.122050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a73da6800845eb965c5a57599ac763)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.123980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.125980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 985/1978] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:06.133283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.133605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.133887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.142862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:06.158830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:06.160386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.169263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 986/1979] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:06.173266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.175279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a73da6800845eb965c5a57599ac763'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.182701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a73da6800845eb965c5a57599ac763'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.182858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3167f2d-e66f-4e3d-8ec3-75bc71ac465b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.183688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a73da6800845eb965c5a57599ac763'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.187918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.188971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.189244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.189737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.190800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:06.191282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.193103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.193869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a73da6800845eb965c5a57599ac763'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.195079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a73da6800845eb965c5a57599ac763'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.215388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 987/1980] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:06.216670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 994/1981] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:06 2022] DELETE /identity/v3/users/69a73da6800845eb965c5a57599ac763 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:06.217097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.219944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.242033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b0796-37b6-4747-80d1-64851f71c93a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.337333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.338563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.338962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.339449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.340790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.344549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.415530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 988/1982] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:06.416031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.428166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080d3b7-b33c-4ff4-945b-ffea24ba6a85 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.513287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.514090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.514478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.516853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.517783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.520001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.565190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 995/1983] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:06.569407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.590700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ddda9-684b-477e-a42d-dfb152cac604 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.598228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.599141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.602309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.602309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.602309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.603742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.606542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.608610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.621814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60155-b83f-43c5-92be-dbef8e1e939c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.628839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 989/1984] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:06.629946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.638917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.640387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.641686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.642173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] PATH_INFO: `/v3/projects/be24806334ea4c11b27a82889bc859d5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.644263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be24806334ea4c11b27a82889bc859d5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.646437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.651554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074e1a-7fb0-4138-9b95-84cdec1dc70e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.655992 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:06.658871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.659986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.660265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.660551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.662482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.665510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.683527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 990/1985] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:06.687814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:06.700011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42155b4-5de0-4d60-8862-8d435b3f6a49 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:06.710963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be24806334ea4c11b27a82889bc859d5', 'request_id': 'req-91264c1e-7bda-4c76-b622-8b814f92f173'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.723068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be24806334ea4c11b27a82889bc859d5', 'request_id': 'req-91264c1e-7bda-4c76-b622-8b814f92f173'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.742353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be24806334ea4c11b27a82889bc859d5', 'request_id': 'req-91264c1e-7bda-4c76-b622-8b814f92f173'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.759749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] The token cache is being invalidate because project be24806334ea4c11b27a82889bc859d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:06.762277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.763360 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-91264c1e-7bda-4c76-b622-8b814f92f173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:06.767589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 996/1986] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:06 2022] DELETE /identity/v3/projects/be24806334ea4c11b27a82889bc859d5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:06.773334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a7ec-a017-4cc5-ac76-3299a810988d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.773765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a7ec-a017-4cc5-ac76-3299a810988d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.774075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a7ec-a017-4cc5-ac76-3299a810988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.814285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0fd6a7ec-a017-4cc5-ac76-3299a810988d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:06.816317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0fd6a7ec-a017-4cc5-ac76-3299a810988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.824933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:06.826375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.826852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.827370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] PATH_INFO: `/v3/projects/07608e0766ec415f8daddf6275b5e1d5/users/283312bbe85948b884162eedcc02127b/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.829485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 997/1987] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:06.837437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.837728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.838012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.850947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07608e0766ec415f8daddf6275b5e1d5, user_id=283312bbe85948b884162eedcc02127b, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:06.855109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecddbeb-5bf6-4908-baa6-ddda918c35c8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:06.863813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:06.865179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.876832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 991/1988] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:06 2022] PUT /identity/v3/projects/07608e0766ec415f8daddf6275b5e1d5/users/283312bbe85948b884162eedcc02127b/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:06.887294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:06.887653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:06.887989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:06.925518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] MFA Rules not processed for user `283312bbe85948b884162eedcc02127b`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:06.927318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:06.973095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:06.995231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 998/1989] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:06.996236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.018598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e02ec-5731-4cac-8e06-e4099c4330d8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.025461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.027012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.028331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.028941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.030037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:07.030403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.033198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.039996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 992/1990] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:07.041537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.043094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.059599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 999/1991] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:07.059599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.068669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451a4c4-fcc4-4c0c-9b12-c96283ebf990 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.069906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.075523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.076521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.076809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.077090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] PATH_INFO: `/v3/users/415e994a56914028b2b16cc83ae5ed99` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.078310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415e994a56914028b2b16cc83ae5ed99)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.081011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.141808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dff823-dfe0-4003-a26f-a285e55f809b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.143369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415e994a56914028b2b16cc83ae5ed99'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:07.144107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415e994a56914028b2b16cc83ae5ed99'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:07.146943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.148094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.148397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.148837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.152527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415e994a56914028b2b16cc83ae5ed99'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:07.160516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.161864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415e994a56914028b2b16cc83ae5ed99'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:07.162079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.162730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d7c2722-652d-45d1-9fa5-5e2ecc675058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415e994a56914028b2b16cc83ae5ed99'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:07.172812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1000/1992] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:07.173431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.185887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b4c2-438f-4177-80f3-a66b098bbd68 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.191708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.192747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.193040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.193323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.194219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.197554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.204662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 993/1993] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:07 2022] DELETE /identity/v3/users/415e994a56914028b2b16cc83ae5ed99 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:07.206714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.207016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.207297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.219381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:07.237982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1001/1994] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:07 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:07.243194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.244505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:07.245831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.248586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.325003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 994/1995] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:07.341739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.345390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.349629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a91438-bfd7-4f91-8284-31fbdd04cc9d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.360135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.361238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.361649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.362002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.362942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.365235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.403649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1002/1996] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:07 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:07.408696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.415184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:07.434826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1474e38-1e46-4a9c-a8ce-e999b02bd161 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.446358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.447620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.448878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.449342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.450318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.454185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.464843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277a3a-b564-4e87-839e-3bc30422119a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.475096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1003/1997] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:07.475544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.475544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.475544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.475753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.476245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.487775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a5bf8-e648-4976-9a27-5eeda0535ec0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.493107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.493833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.494125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.494516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.496695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.499333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.513754 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.516172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec85c72-b4ab-43a5-a442-84a4e462f23b service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.520661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1004/1998] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:07.523337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.551219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 995/1999] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:07.551361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ddd5-7214-404e-ad2f-d6bf0dc3f3d0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.557753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.559182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.559471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.559751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] PATH_INFO: `/v3/projects/589fb7c0fae74e0783345875880da162/users/81cf269d95194a04b571ce8bf8cb8cff/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.578589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589fb7c0fae74e0783345875880da162, user_id=81cf269d95194a04b571ce8bf8cb8cff, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.586326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.625510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1005/2000] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:07 2022] PUT /identity/v3/projects/589fb7c0fae74e0783345875880da162/users/81cf269d95194a04b571ce8bf8cb8cff/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:07.630666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.630977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.631273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.688337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] MFA Rules not processed for user `81cf269d95194a04b571ce8bf8cb8cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:07.690523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:07.784435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 996/2001] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:07.798512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:07.931200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3ec0d-4a45-424f-904c-92fa4bd1eb66 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:07.937396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:07.938403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:07.938882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:07.939385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:07.940425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:07.942742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:07.996400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1006/2002] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:07 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:08.001142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.014776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a9b8-0f4f-4607-80bb-c2392fa7add3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.131803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.131803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.131803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.131803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.132834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.135498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.155879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.157923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.167577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 997/2003] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:08 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:08.172003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.182497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1619-e839-465f-a7bd-74f9606d7bc2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.190063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.190834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.191193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.191585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.192484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.194159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.205334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 998/2004] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:08.206117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.212933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.215811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:08.236851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d68b9-64dd-4f32-9b7b-94d709ea61a9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.252317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.254739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.255376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.255840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] PATH_INFO: `/v3/projects/0af27b7f06f74d5d8487f81b931f05f9` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.257785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af27b7f06f74d5d8487f81b931f05f9)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.260657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.267917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822cbc8-a81d-40b1-9863-444faddb7690 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.273180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.273850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.274142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.274423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.276942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.321346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:08.332062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af27b7f06f74d5d8487f81b931f05f9', 'request_id': 'req-866b4547-60a6-4a26-89ee-77cb02a8528d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.340764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af27b7f06f74d5d8487f81b931f05f9', 'request_id': 'req-866b4547-60a6-4a26-89ee-77cb02a8528d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.350623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af27b7f06f74d5d8487f81b931f05f9', 'request_id': 'req-866b4547-60a6-4a26-89ee-77cb02a8528d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.355623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.357268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.367692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1007/2005] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:08.368544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.372111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] The token cache is being invalidate because project 0af27b7f06f74d5d8487f81b931f05f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:08.372702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.373635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.376295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 999/2006] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:08 2022] DELETE /identity/v3/projects/0af27b7f06f74d5d8487f81b931f05f9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:08.380147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.381916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.382026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c859871-92b9-4c28-b98c-27ba1a83b87e service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.448268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.449968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.450401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.450928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] PATH_INFO: `/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4/users/b11d682e98564bf4b1fdc13f8f01935b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.464281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b4547-60a6-4a26-89ee-77cb02a8528d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.468150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a0036a72dd4ae49fffd938b49fb2e4, user_id=b11d682e98564bf4b1fdc13f8f01935b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.470795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.471308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.471741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.472068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.472393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] PATH_INFO: `/v3/users/1a0b7cff53f14016836ee60fc6197e82` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.473882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0b7cff53f14016836ee60fc6197e82)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.476676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.486427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1008/2007] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:08 2022] PUT /identity/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4/users/b11d682e98564bf4b1fdc13f8f01935b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:08.490382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.492905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.537171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0b7cff53f14016836ee60fc6197e82'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.538884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0b7cff53f14016836ee60fc6197e82'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.549112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0b7cff53f14016836ee60fc6197e82'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.557248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0b7cff53f14016836ee60fc6197e82'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.557884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0b7cff53f14016836ee60fc6197e82'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:08.576656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0d93-9721-43f9-8b5f-c47de7e00552 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.576934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1000/2008] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:08 2022] DELETE /identity/v3/users/1a0b7cff53f14016836ee60fc6197e82 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:08.583131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:08.653374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.654071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.654368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.654805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.655536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.657227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108aac2f-9ab6-41f6-99ee-88a63c46a837 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.667942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1009/2009] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:08.672403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.673870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.689063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a770d-ab39-4afb-b96f-978c6a3e7b15 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:08.694234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:08.695136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.695418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.695696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] PATH_INFO: `/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4/users/b11d682e98564bf4b1fdc13f8f01935b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.698574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a0036a72dd4ae49fffd938b49fb2e4, user_id=b11d682e98564bf4b1fdc13f8f01935b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:08.701250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:08.720062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1001/2010] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:08 2022] PUT /identity/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4/users/b11d682e98564bf4b1fdc13f8f01935b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:08.724939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:08.725297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:08.725687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:08.762873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] MFA Rules not processed for user `b11d682e98564bf4b1fdc13f8f01935b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:08.764497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.901749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1010/2011] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:08.911162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.913379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.936452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:08.938636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:08.972360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:09.018508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8d1e8-dda1-422d-a128-def656f3a710 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.022965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.023938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.024348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.024727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.037118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.039390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c127-c525-4ce2-8bbf-a46d1f5c3141 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.067840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1002/2012] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:09.085862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210144b5-2bfa-4043-bd68-536b99455648 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.096543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.099495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.099844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.101530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] PATH_INFO: `/v3/projects/ff04824d29bd4fedb88083c0537b3925` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.102748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff04824d29bd4fedb88083c0537b3925)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.116794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.191095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:09.211792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff04824d29bd4fedb88083c0537b3925', 'request_id': 'req-2275896c-1a4c-49b0-8a98-52ba857183a0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.222555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff04824d29bd4fedb88083c0537b3925', 'request_id': 'req-2275896c-1a4c-49b0-8a98-52ba857183a0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.232510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff04824d29bd4fedb88083c0537b3925', 'request_id': 'req-2275896c-1a4c-49b0-8a98-52ba857183a0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.251984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] The token cache is being invalidate because project ff04824d29bd4fedb88083c0537b3925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:09.252355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.253093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2275896c-1a4c-49b0-8a98-52ba857183a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.255238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1011/2013] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:08 2022] DELETE /identity/v3/projects/ff04824d29bd4fedb88083c0537b3925 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:09.263768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.264361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.264361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.284086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:09.285426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.400417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1003/2014] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:09.409215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.409611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.410059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.450305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:09.454384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.478393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1012/2015] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:09.483598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.500367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28792474-b5fe-458f-8303-82ad3850b85e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.506331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.507544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.507936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.508307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.509183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:09.509562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.511770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.546684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1004/2016] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:09.551211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.561391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01fdc2-822c-4fda-a3ab-7ba0196bd308 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.567262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.568478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.568769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.569180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.569981 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.574976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.624137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1013/2017] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:09.625563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.639897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f646769-8a78-4f90-bf0a-2b4c6247787a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.640824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.642526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.724249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.725272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.725696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.726055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.726909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.729928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.730728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef32bb-1ab4-4492-af62-04ec8cb5a30a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.735672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.736691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.737042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.737528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] PATH_INFO: `/v3/users/81cf269d95194a04b571ce8bf8cb8cff` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.738808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cf269d95194a04b571ce8bf8cb8cff)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.740876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.754463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1005/2018] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:09.759200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.772834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854bf0d-8c27-4fc9-816b-bd9742217807 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.782185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.784932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.784932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.785288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.786161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.788108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.800249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cf269d95194a04b571ce8bf8cb8cff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.801046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1006/2019] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:09.804831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.808986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cf269d95194a04b571ce8bf8cb8cff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.809842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cf269d95194a04b571ce8bf8cb8cff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.816334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e89-cc4a-4526-bfde-93281a8d7746 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.822148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.822564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cf269d95194a04b571ce8bf8cb8cff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.823175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.823445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-04cd4d7d-96c7-47cd-86a2-26c020131640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cf269d95194a04b571ce8bf8cb8cff'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:09.823541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.823945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.824673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.826320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.843119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1007/2020] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:09.844230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.845957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.846512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1014/2021] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:09 2022] DELETE /identity/v3/users/81cf269d95194a04b571ce8bf8cb8cff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:09.850998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.851379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.851662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.859473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99bf2e-2ac0-4603-91cb-db2b063b98f8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:09.870374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:09.871734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.877467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:09.889502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:09.920510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:09.921434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.921721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.922001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] PATH_INFO: `/v3/projects/539e771de1884aa58f4e53f9b7e58a2c/users/094d7d2c121e43899922f1becbe14cc6/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.937115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] RBAC: Authorizing `identity:create_grant(project_id=539e771de1884aa58f4e53f9b7e58a2c, user_id=094d7d2c121e43899922f1becbe14cc6, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:09.938914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1015/2022] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:09.939791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739448c1-1193-4d21-b602-30a126c0000f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:09.949524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:09.950873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:09.953982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1008/2023] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:09 2022] PUT /identity/v3/projects/539e771de1884aa58f4e53f9b7e58a2c/users/094d7d2c121e43899922f1becbe14cc6/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:09.965972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880379c-d101-4437-a34c-d582415afd93 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:09.966266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880379c-d101-4437-a34c-d582415afd93 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:09.966561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880379c-d101-4437-a34c-d582415afd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:09.994385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1880379c-d101-4437-a34c-d582415afd93 None None] MFA Rules not processed for user `094d7d2c121e43899922f1becbe14cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:09.995908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1880379c-d101-4437-a34c-d582415afd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:10.009348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2271969-7967-4bbf-bbda-b0f81347adf2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.065806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.066467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.066763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.067042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.068932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1009/2024] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:10.073844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880379c-d101-4437-a34c-d582415afd93 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.137323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.138784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.139354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880379c-d101-4437-a34c-d582415afd93 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.144155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.144791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.145082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.145362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.146059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.147987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.149474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1016/2025] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:10.178976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1010/2026] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:10 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:10.182946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.193924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17cf61-7867-452f-a4cb-4d2b8640f267 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.214968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:10.295375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.296105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.296456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.296739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.297502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.300076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.324044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1017/2027] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:10 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:10.327948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.345161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cb879-9b39-4f36-946c-0947130dfeb3 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.358774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.360012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.361067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.361607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.363256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.365883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.382815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1011/2028] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:10.387738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.405619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e097-5718-4849-9f00-b9bf6ed2836f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.413794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.414808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.415316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.415550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] PATH_INFO: `/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a/users/e3ac4ef0365345d398c16c0ae77d4fbe/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.440124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ad1e8b32814a5f94b72f14c8ebbf7a, user_id=e3ac4ef0365345d398c16c0ae77d4fbe, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.444266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.467084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1018/2029] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:10 2022] PUT /identity/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a/users/e3ac4ef0365345d398c16c0ae77d4fbe/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:10.470905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.495120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226acf8-0437-4a61-917f-2f84bade9c38 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.515795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:10.617916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.618644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.618938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.619222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.622001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.626595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed670b-bbb6-4521-89f5-e2ac56b9bfaa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.654701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1012/2030] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:10.665183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.680464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94774800-b7cd-43a1-8112-2dfb00d33624 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.697453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.699000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.699730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.700262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] PATH_INFO: `/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a/users/e3ac4ef0365345d398c16c0ae77d4fbe/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.703597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ad1e8b32814a5f94b72f14c8ebbf7a, user_id=e3ac4ef0365345d398c16c0ae77d4fbe, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.707068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:10.731995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1019/2031] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:10 2022] PUT /identity/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a/users/e3ac4ef0365345d398c16c0ae77d4fbe/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:10.736609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.737147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.737511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.756085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:10.757811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:10.829745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] MFA Rules not processed for user `e3ac4ef0365345d398c16c0ae77d4fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:10.831365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:10.863927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e7923-6db7-487c-8a3f-84742b86f3e4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:10.886372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:10.889205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:10.890413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:10.891136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] PATH_INFO: `/v3/projects/589fb7c0fae74e0783345875880da162` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:10.895196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589fb7c0fae74e0783345875880da162)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:10.899492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:11.002774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1013/2032] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:11.006344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589fb7c0fae74e0783345875880da162', 'request_id': 'req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.019502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589fb7c0fae74e0783345875880da162', 'request_id': 'req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.026777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.028263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.029546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589fb7c0fae74e0783345875880da162', 'request_id': 'req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.046576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:11.058396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] The token cache is being invalidate because project 589fb7c0fae74e0783345875880da162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:11.059894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.062034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.064427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1020/2033] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:10 2022] DELETE /identity/v3/projects/589fb7c0fae74e0783345875880da162 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:11.068578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.071136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.107068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9650-e3b4-44e6-b9e3-f1942d46f659 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:11.157179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc6a2e-7e54-407f-8e4b-a62942c545d8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:11.162709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:11.163659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:11.164037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:11.164256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] PATH_INFO: `/v3/users/b11d682e98564bf4b1fdc13f8f01935b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:11.165630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:11.165765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11d682e98564bf4b1fdc13f8f01935b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:11.167076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:11.167439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:11.167792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:11.168340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:11.169758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.179831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:11.221912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11d682e98564bf4b1fdc13f8f01935b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.230536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11d682e98564bf4b1fdc13f8f01935b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.231161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11d682e98564bf4b1fdc13f8f01935b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.242825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11d682e98564bf4b1fdc13f8f01935b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.243800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11d682e98564bf4b1fdc13f8f01935b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.251120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:11.253218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:11.270741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1014/2034] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:11.284204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1021/2035] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:11 2022] DELETE /identity/v3/users/b11d682e98564bf4b1fdc13f8f01935b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:11.294963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.299143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.327784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4e6b-b659-42e0-8766-d7465168f895 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:11.386677 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.388314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.418663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:11.420995 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:11.421651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:11.422114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] PATH_INFO: `/v3/users/a805f07722794a05bf9c549cc3d8e022` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:11.424652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a805f07722794a05bf9c549cc3d8e022)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:11.428412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:11.546287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a805f07722794a05bf9c549cc3d8e022'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.547104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a805f07722794a05bf9c549cc3d8e022'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.551927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e24632-954b-42fc-8b4d-6b10036b8f3a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:11.566292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:11.567244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:11.567798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:11.569955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:11.572565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.573555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a805f07722794a05bf9c549cc3d8e022'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.610424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a805f07722794a05bf9c549cc3d8e022'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.611734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bab0d701-ff51-489c-a30b-f04063398b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a805f07722794a05bf9c549cc3d8e022'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:11.658165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:11.659704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1015/2036] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:11 2022] DELETE /identity/v3/users/a805f07722794a05bf9c549cc3d8e022 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:11.662040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:11.663632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:11.664056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:11.719005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:11.722082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:11.742316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:11.744591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1022/2037] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:11.749851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.832636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:11.922108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1016/2038] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:11.959611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.962683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:11.983116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:11.984883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:12.021212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5fd96-640b-4f0b-8e19-5ccc5d04a86e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.038198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794651-e325-4114-b298-153277195234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.042075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794651-e325-4114-b298-153277195234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.045144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794651-e325-4114-b298-153277195234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.048517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794651-e325-4114-b298-153277195234 admin admin] PATH_INFO: `/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.054864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794651-e325-4114-b298-153277195234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a0036a72dd4ae49fffd938b49fb2e4)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.065738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794651-e325-4114-b298-153277195234 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.173209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a424b6-2544-4aad-9f7e-9813c7600201 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.225176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a0036a72dd4ae49fffd938b49fb2e4', 'request_id': 'req-f3794651-e325-4114-b298-153277195234'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:12.242323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a0036a72dd4ae49fffd938b49fb2e4', 'request_id': 'req-f3794651-e325-4114-b298-153277195234'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:12.266694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a0036a72dd4ae49fffd938b49fb2e4', 'request_id': 'req-f3794651-e325-4114-b298-153277195234'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:12.287829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.288726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.288887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] The token cache is being invalidate because project 80a0036a72dd4ae49fffd938b49fb2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:12.289298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.289714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.289925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:12.291075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f3794651-e325-4114-b298-153277195234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:12.292746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:12.293655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1017/2039] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:11 2022] DELETE /identity/v3/projects/80a0036a72dd4ae49fffd938b49fb2e4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:12.299126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.299418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.299699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.332259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.336424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bcc20-1835-4f04-a935-bc0f47c15905 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.372715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:12.374214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1023/2040] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:12.375567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:12.456231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1018/2041] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:12.464871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.467816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.467816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.487110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:12.488389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:12.497192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1024/2042] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:12.501716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.513238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b890a-13a0-4fd3-9891-fac1202d5c78 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.520100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.521070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.521447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.521974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.523330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:12.523802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.528834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.545496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1019/2043] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:12.550330 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.560766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f48b4-86fb-4871-9091-bac93b9a5b5e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.565642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.566314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.566599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.566871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.567708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.569602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.608049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1025/2044] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:12.612550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.624471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cec2d-993b-401b-89bd-127fdcfdd5b7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.684106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:12.707882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.708605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.708894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.709171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.709876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.711811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.735450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1020/2045] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:12.739156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.749695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad0dc-1cfd-492b-9be4-928354610b74 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.754462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.755202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.755412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.755681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.756465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.758083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.769294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1026/2046] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:12.774780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.791161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a11e7-062f-435c-b36a-63e1c17407b6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.796837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.797588 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.797977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.798263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.799015 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.800924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35d118-dcab-4dce-8133-be7c404207d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.814993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1021/2047] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:12.816517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:12.829185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b4b1-acda-4af9-b063-5c65e061f161 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:12.834157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:12.835176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.835551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.835892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] PATH_INFO: `/v3/projects/c7111b4f490648e181b40ea2363a48f6/users/dc13d146b6984895a06d1092ce87ff44/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.852525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7111b4f490648e181b40ea2363a48f6, user_id=dc13d146b6984895a06d1092ce87ff44, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:12.855814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:12.868532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1027/2048] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:12 2022] PUT /identity/v3/projects/c7111b4f490648e181b40ea2363a48f6/users/dc13d146b6984895a06d1092ce87ff44/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:12.879992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:12.880350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:12.880641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:12.908544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] MFA Rules not processed for user `dc13d146b6984895a06d1092ce87ff44`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:12.909802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:12.986448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1022/2049] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:12.991014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.046474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:13.081579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.083620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.093036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adacbc-5b4d-44dc-8669-cd5f1a52b650 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.098434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.100888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.101340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.101883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae4155-f633-4167-9bc7-21c9fe79af6e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.102343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.103871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.106453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.108213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.109671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.110082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.110762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] PATH_INFO: `/v3/projects/69d021ba3f2f4ab7ba2fafa267385c86` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.112952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d021ba3f2f4ab7ba2fafa267385c86)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.117256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.139656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1028/2050] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:12 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:13.142546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.197135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d021ba3f2f4ab7ba2fafa267385c86', 'request_id': 'req-738ccd39-d03f-4d36-87f3-33e583296995'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.205440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d021ba3f2f4ab7ba2fafa267385c86', 'request_id': 'req-738ccd39-d03f-4d36-87f3-33e583296995'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.219123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d021ba3f2f4ab7ba2fafa267385c86', 'request_id': 'req-738ccd39-d03f-4d36-87f3-33e583296995'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.223567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df7cf-45dd-4f88-8893-5bc312e3ff6b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.230701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] The token cache is being invalidate because project 69d021ba3f2f4ab7ba2fafa267385c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:13.231077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.231780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.234488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1023/2051] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:13 2022] DELETE /identity/v3/projects/69d021ba3f2f4ab7ba2fafa267385c86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:13.244332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.245901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.284586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.285299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.285586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.285867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.286575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.288503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:13.288851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.319012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1029/2052] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:13 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:13.320574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.323855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.339872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844ed3-eb4a-4617-b162-ea5ee4095715 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.344263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ccd39-d03f-4d36-87f3-33e583296995 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.345998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.346672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.346962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.347243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.348126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.350027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.352935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.354229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.354719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.355207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] PATH_INFO: `/v3/users/fce9c471309f477994ec17a5d958437b` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.357499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce9c471309f477994ec17a5d958437b)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.360208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.361613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1030/2053] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:13.370800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.389575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be9f4b-f228-49e7-b879-4c6e88b7b4fb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.396743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.398223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.398515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.398797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] PATH_INFO: `/v3/projects/39155d728e604a7aa7052565ac26c957/users/10eeda5f15ff4194ac4fbfaa58833ec4/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.428170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39155d728e604a7aa7052565ac26c957, user_id=10eeda5f15ff4194ac4fbfaa58833ec4, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.434609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.460111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1031/2054] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:13 2022] PUT /identity/v3/projects/39155d728e604a7aa7052565ac26c957/users/10eeda5f15ff4194ac4fbfaa58833ec4/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:13.462110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.472603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce9c471309f477994ec17a5d958437b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.473581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce9c471309f477994ec17a5d958437b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.485329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce9c471309f477994ec17a5d958437b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.496432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce9c471309f477994ec17a5d958437b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.497200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce9c471309f477994ec17a5d958437b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.506205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:13.544002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1024/2055] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:13 2022] DELETE /identity/v3/users/fce9c471309f477994ec17a5d958437b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:13.588750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b5a7-4e46-4e51-89a4-5aa2d7c7d3a5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.690865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.691760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.692237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.692443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.693298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.697182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.716157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1032/2056] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:13.717326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.718779 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.726789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:13.729400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.738841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9b5e-bfc7-4262-acb5-f9f193892c34 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.747347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888a179-8fde-46e2-861b-6ad9e807d134 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:13.752540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.753613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.753905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.754320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] PATH_INFO: `/v3/projects/39155d728e604a7aa7052565ac26c957/users/10eeda5f15ff4194ac4fbfaa58833ec4/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.756647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39155d728e604a7aa7052565ac26c957, user_id=10eeda5f15ff4194ac4fbfaa58833ec4, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.758530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:13.760747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b6dc2-3e49-4367-b895-19209a263f77 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.763549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.763847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.764164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] PATH_INFO: `/v3/users/283312bbe85948b884162eedcc02127b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.767655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=283312bbe85948b884162eedcc02127b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:13.772567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:13.776858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1025/2057] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:13 2022] PUT /identity/v3/projects/39155d728e604a7aa7052565ac26c957/users/10eeda5f15ff4194ac4fbfaa58833ec4/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:13.788079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.788807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.789413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.842904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] MFA Rules not processed for user `10eeda5f15ff4194ac4fbfaa58833ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:13.852286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:13.871163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283312bbe85948b884162eedcc02127b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.889285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283312bbe85948b884162eedcc02127b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.894581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283312bbe85948b884162eedcc02127b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.909461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283312bbe85948b884162eedcc02127b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.910489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cabc7117-0664-4aa2-b28d-432b8419e4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283312bbe85948b884162eedcc02127b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:13.959517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1033/2058] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:13 2022] DELETE /identity/v3/users/283312bbe85948b884162eedcc02127b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:13.961629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:13.962011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:13.962672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:13.987313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:13.989028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.014075 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1026/2059] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:14.022854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.024397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.028614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:14.059975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:14.097228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1034/2060] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:14.098273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.099687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.118895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5544f-58f1-4ba3-bcd4-637391b5a3f2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:14.126244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:14.127422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:14.127733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:14.128241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] PATH_INFO: `/v3/projects/afa9d01cd7ee41c3a47e4a5d102ba094` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:14.129743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa9d01cd7ee41c3a47e4a5d102ba094)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:14.131793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:14.133638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffea54-396a-4866-9857-1459b1addee5 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:14.187183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa9d01cd7ee41c3a47e4a5d102ba094', 'request_id': 'req-05ed4a99-5eed-498e-813c-118d4fa5577d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.187520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:14.188482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:14.188852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:14.189220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:14.194150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa9d01cd7ee41c3a47e4a5d102ba094', 'request_id': 'req-05ed4a99-5eed-498e-813c-118d4fa5577d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.200625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa9d01cd7ee41c3a47e4a5d102ba094', 'request_id': 'req-05ed4a99-5eed-498e-813c-118d4fa5577d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.211913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] The token cache is being invalidate because project afa9d01cd7ee41c3a47e4a5d102ba094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:14.212230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.212882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.215021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1035/2061] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:14 2022] DELETE /identity/v3/projects/afa9d01cd7ee41c3a47e4a5d102ba094 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:14.215859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.218481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.263603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:14.264905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:14.277336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1027/2062] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:14.278323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.290797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a4d9-fbb0-458e-9e86-66f6093362ad service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:14.307487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed4a99-5eed-498e-813c-118d4fa5577d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:14.311661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:14.312362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:14.312649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:14.312925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:14.315067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.406659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:14.408202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:14.408753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:14.409262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] PATH_INFO: `/v3/users/68485dfac0ac431187da8d3f84b70ad3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:14.410853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68485dfac0ac431187da8d3f84b70ad3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:14.414516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:14.421313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:14.425774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:14.469133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1036/2063] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:14.516304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.519063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.531662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:14.535714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:14.626629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68485dfac0ac431187da8d3f84b70ad3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.628223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68485dfac0ac431187da8d3f84b70ad3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.636999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278a20-f937-4d67-b393-cb03c2f1ad14 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:14.641198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68485dfac0ac431187da8d3f84b70ad3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.642872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:14.643854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:14.644327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:14.644811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:14.647052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:14.655238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68485dfac0ac431187da8d3f84b70ad3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.656098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68485dfac0ac431187da8d3f84b70ad3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:14.692247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1028/2064] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:14 2022] DELETE /identity/v3/users/68485dfac0ac431187da8d3f84b70ad3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:14.731750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:14.733343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:14.743449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1037/2065] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:14.961454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:14.964050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.075237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:15.077090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.099809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13feff-22a4-4d31-a486-b2c20a724e06 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:15.110819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:15.112143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.112656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.113093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] PATH_INFO: `/v3/users/dc13d146b6984895a06d1092ce87ff44` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.113222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35e8f-c1af-4fea-bb0a-14dcf4607b76 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:15.114682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc13d146b6984895a06d1092ce87ff44)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:15.118867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:15.121326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:15.122405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.122766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.122971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] PATH_INFO: `/v3/projects/07608e0766ec415f8daddf6275b5e1d5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.124589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07608e0766ec415f8daddf6275b5e1d5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:15.126503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:15.247104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc13d146b6984895a06d1092ce87ff44'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.251506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07608e0766ec415f8daddf6275b5e1d5', 'request_id': 'req-6eabbe60-e316-48ca-95c6-17025d6cc610'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.262441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07608e0766ec415f8daddf6275b5e1d5', 'request_id': 'req-6eabbe60-e316-48ca-95c6-17025d6cc610'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.265265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc13d146b6984895a06d1092ce87ff44'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.266044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc13d146b6984895a06d1092ce87ff44'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.273794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07608e0766ec415f8daddf6275b5e1d5', 'request_id': 'req-6eabbe60-e316-48ca-95c6-17025d6cc610'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.283531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc13d146b6984895a06d1092ce87ff44'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.284306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8caed278-7d6b-4c84-8075-a5efbf48aca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc13d146b6984895a06d1092ce87ff44'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.289247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] The token cache is being invalidate because project 07608e0766ec415f8daddf6275b5e1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:15.290425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.291129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.294744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1029/2066] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:14 2022] DELETE /identity/v3/projects/07608e0766ec415f8daddf6275b5e1d5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:15.297742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:15.299195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.329167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1038/2067] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:15 2022] DELETE /identity/v3/users/dc13d146b6984895a06d1092ce87ff44 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:15.329167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b8e-6a41-454c-8c97-91894d33290c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.329167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b8e-6a41-454c-8c97-91894d33290c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.329167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b8e-6a41-454c-8c97-91894d33290c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.355172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-12167b8e-6a41-454c-8c97-91894d33290c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:15.356285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:15.356424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-12167b8e-6a41-454c-8c97-91894d33290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.386447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:15.398689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabbe60-e316-48ca-95c6-17025d6cc610 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:15.438092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1039/2068] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:15.445601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5f39-e26f-4240-bfd6-7e0cdbf4f768 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.445601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5f39-e26f-4240-bfd6-7e0cdbf4f768 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.445601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5f39-e26f-4240-bfd6-7e0cdbf4f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.470493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-644f5f39-e26f-4240-bfd6-7e0cdbf4f768 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:15.472610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-644f5f39-e26f-4240-bfd6-7e0cdbf4f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.478299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:15.480045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.480342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.480780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] PATH_INFO: `/v3/projects/b1425838f96e498494616a8699f8e643` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.482216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1425838f96e498494616a8699f8e643)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:15.483003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1040/2069] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:15.484945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:15.489762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.490154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.490533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.513389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:15.514821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.524464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1041/2070] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:15.525476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:15.528516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.574734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1425838f96e498494616a8699f8e643', 'request_id': 'req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.583717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1425838f96e498494616a8699f8e643', 'request_id': 'req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.617572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1425838f96e498494616a8699f8e643', 'request_id': 'req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.647573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] The token cache is being invalidate because project b1425838f96e498494616a8699f8e643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:15.649360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.652104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:15.656451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1030/2071] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:15 2022] DELETE /identity/v3/projects/b1425838f96e498494616a8699f8e643 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:15.657421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:15.660002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.674726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eaf3e-0688-41a5-8b23-c4d26b7ffb7b None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:15.778184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:15.780826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.781829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.782213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.792398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.835229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9d92-8a4b-4929-a2ce-2a9bdb661e16 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:15.854647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:15.855561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.855945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.856368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.857535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:15.857806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:15.860393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9fb1-2485-4612-a614-078728d14b79 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:15.893665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1031/2072] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:15.895129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:15.895426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:15.895714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:15.917432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:15.942746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:15.946261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:15.968264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1032/2073] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:15.969210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:15.976213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:15.978208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753201dc-28e5-4f7d-a683-6d244be77b4d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:15.994485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f791d-d30f-49f0-8794-37da321edccc None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.000427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1042/2074] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:16.002471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.003094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.003632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.015546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.018244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.019347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.019647 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.022436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.028600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.056396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:16.057824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:16.070836 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1043/2075] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:16.075811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.084807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1033/2076] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:15 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:16.090011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.094243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc91b1-8c2e-4470-82ac-603456977da2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.129573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:16.229367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.230128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.230474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.230823 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.231637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:16.232180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.234278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.260942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1044/2077] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:11:16.266033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.280841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde63ed-0e3f-49c8-b1ae-262bbc387217 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.287612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.288316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.288653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.288928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.289914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.292398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.295271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953046-d9b7-4906-9cce-023ae297f6f8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.317507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.318286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.318586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.319257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.320082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.325292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.332119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1045/2078] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:16.333265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.358916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1034/2079] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:16.363278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.392010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1131c-8e93-4b52-a0f7-7212ab08f88f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.459190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434f79c-6a35-4244-932b-23f834a50e3e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.469087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.470126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.470620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.471204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.473238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.476041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.485782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.486444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.486737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.487318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.488726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.492130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.505196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1046/2080] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:16.509473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.515062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1035/2081] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:16.516258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.527319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf25e6-67b6-409a-95c9-36582a4474c9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.535045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.535727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.536366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.536478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.537046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd175d-8bcb-409b-8da2-2e21e22f667e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.537353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.539575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.556023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1047/2082] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:16.561222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.589765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.589765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.589765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.589765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.590519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.590600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9684a8-c7a3-42a1-85a6-466addb18934 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.590682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.603357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.603357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.603357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.603357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.603831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.603831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.612689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1036/2083] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:16.623575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.626888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1048/2084] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:16.630624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.639897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0eb54-e83f-453c-8e7f-a5146b26a923 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.644569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155fa46-6eb8-487a-a157-3e8c5f402a4d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.646264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.646966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.647304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.647589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] PATH_INFO: `/v3/projects/0e47670aec264cf79292e12b33cea654/users/1b2c0597381c4e27a21ff56c008fb82f/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.649606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.650512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.651024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.651347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] PATH_INFO: `/v3/projects/03c835e7ffb64007b10825c0a74cc8ed/users/d9ba21fee2934a13bfbe0315d335963d/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.669102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e47670aec264cf79292e12b33cea654, user_id=1b2c0597381c4e27a21ff56c008fb82f, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.670587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c835e7ffb64007b10825c0a74cc8ed, user_id=d9ba21fee2934a13bfbe0315d335963d, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.671999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b114c1d-5927-413e-afb8-3a3292711e4f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.673179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f584360-6cf7-4b52-9b68-e1a1fe15cce3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.693566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1037/2085] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:16 2022] PUT /identity/v3/projects/0e47670aec264cf79292e12b33cea654/users/1b2c0597381c4e27a21ff56c008fb82f/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:16.694692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1049/2086] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:16 2022] PUT /identity/v3/projects/03c835e7ffb64007b10825c0a74cc8ed/users/d9ba21fee2934a13bfbe0315d335963d/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:16.708645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.708957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.709249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.710155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.710585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.710997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.748814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] MFA Rules not processed for user `1b2c0597381c4e27a21ff56c008fb82f`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:16.750253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:16.762466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] MFA Rules not processed for user `d9ba21fee2934a13bfbe0315d335963d`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:16.763878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:16.767720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:16.794857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:16.827987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1038/2087] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:16.831714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.831714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:16.860522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1050/2088] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:16.861265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.932620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049e61c-9513-4c5b-9ff8-3318e594b7cc None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.937372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e3f08-b291-4b43-8e11-17c4c659691c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:16.938316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.939310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.939594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.939877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] PATH_INFO: `/v3/projects/c7111b4f490648e181b40ea2363a48f6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.941132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7111b4f490648e181b40ea2363a48f6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.942818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:16.943037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.943817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:16.944230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:16.944608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:16.945396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:16.947681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:16.975946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1051/2089] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:16 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:16.977077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:16.979726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.002312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7111b4f490648e181b40ea2363a48f6', 'request_id': 'req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.009808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7111b4f490648e181b40ea2363a48f6', 'request_id': 'req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.019331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7111b4f490648e181b40ea2363a48f6', 'request_id': 'req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.033400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] The token cache is being invalidate because project c7111b4f490648e181b40ea2363a48f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:17.033780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.034469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.037186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1039/2090] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:16 2022] DELETE /identity/v3/projects/c7111b4f490648e181b40ea2363a48f6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:17.038177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.040400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.048854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c124c-4b8b-41ed-b560-e3c075f721e1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.098210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:17.114723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.115444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.115670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.115976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.118105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.120473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e484a5-92f6-48ae-bac2-6d9f6493b8f7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.125719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.126496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.127006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.127184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.128181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.130316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.143772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:17.167296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1040/2091] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:17 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:17.168507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.170791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.187154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc1fd-120f-4a17-b43b-79a4633522b1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.193420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.194617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.195211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.195593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] PATH_INFO: `/v3/users/10eeda5f15ff4194ac4fbfaa58833ec4` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.197975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10eeda5f15ff4194ac4fbfaa58833ec4)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.200614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.212838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.215120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.227476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1052/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:17.228579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.243450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e163ec-95c0-4697-89d1-918a4c648e9c service glance] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.249943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.252965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.253420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.254091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.255325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.257513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.279895 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1053/2093] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:17.281197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.296416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a73d1f-be9c-4032-ae5a-8874d389f2cb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.303173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.303948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.304319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.304605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.305541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.307497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.322964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1054/2094] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:17.324504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.330958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10eeda5f15ff4194ac4fbfaa58833ec4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.332363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10eeda5f15ff4194ac4fbfaa58833ec4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.347601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10eeda5f15ff4194ac4fbfaa58833ec4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.357169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10eeda5f15ff4194ac4fbfaa58833ec4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.357858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-57c81038-8e7c-4f65-b55b-362afb64f972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10eeda5f15ff4194ac4fbfaa58833ec4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:17.365267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56e054-9a38-44f4-a629-0661b430bea1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.378099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.378812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1041/2095] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:17 2022] DELETE /identity/v3/users/10eeda5f15ff4194ac4fbfaa58833ec4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:17.379523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.379821 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.380159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] PATH_INFO: `/v3/projects/791aaab2893b42bf865568631727e439/users/7c2b53b9bd2c4f9288df58c0750f9413/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.431759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=791aaab2893b42bf865568631727e439, user_id=7c2b53b9bd2c4f9288df58c0750f9413, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.437092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.496058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1055/2096] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:17 2022] PUT /identity/v3/projects/791aaab2893b42bf865568631727e439/users/7c2b53b9bd2c4f9288df58c0750f9413/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:17.508930 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098869-d9e1-4715-8e8a-589311322663 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.509444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098869-d9e1-4715-8e8a-589311322663 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.509942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13098869-d9e1-4715-8e8a-589311322663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.581538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-13098869-d9e1-4715-8e8a-589311322663 None None] MFA Rules not processed for user `7c2b53b9bd2c4f9288df58c0750f9413`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:17.583034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-13098869-d9e1-4715-8e8a-589311322663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.684248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.684513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1042/2097] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:17.687050 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:17.819497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284523da-161f-4f27-94c0-c1b8fa67a1de admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:17.830098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:17.831142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:17.831441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:17.831817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:17.843636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:17.845711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:17.887709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1056/2098] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:17 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:17.890550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13098869-d9e1-4715-8e8a-589311322663 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:17.928919 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13098869-d9e1-4715-8e8a-589311322663 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.018292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.020256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.041068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:18.121214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.121902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.122192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.122541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.123174 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.125203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.162818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1043/2099] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:17 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:18.168495 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:18.178326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.187367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62bd12-8ae8-4c35-bdce-7a5a46bd5e6f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.196545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddc48e-a202-4bb8-96d1-477958579643 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.202305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.203204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.204055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.204346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] PATH_INFO: `/v3/projects/39155d728e604a7aa7052565ac26c957` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.209215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.210011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39155d728e604a7aa7052565ac26c957)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.211103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.211319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.211600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.213883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.214936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.219104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.243113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1044/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:18.247707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.272214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebee8-796b-48ce-b8fa-a0684b1b6af3 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.282225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.283265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.283617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.283853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] PATH_INFO: `/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1/users/c10fe4b646334d979d299580ec9f45a3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.309931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d39cd17820a4a519a0dd7f1ed060bf1, user_id=c10fe4b646334d979d299580ec9f45a3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.312876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.314306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39155d728e604a7aa7052565ac26c957', 'request_id': 'req-9b05a606-3e95-42ea-90db-82c1e0c3e294'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.325228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39155d728e604a7aa7052565ac26c957', 'request_id': 'req-9b05a606-3e95-42ea-90db-82c1e0c3e294'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.331646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39155d728e604a7aa7052565ac26c957', 'request_id': 'req-9b05a606-3e95-42ea-90db-82c1e0c3e294'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.336690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1045/2101] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:18 2022] PUT /identity/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1/users/c10fe4b646334d979d299580ec9f45a3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:18.337712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.341628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.346129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] The token cache is being invalidate because project 39155d728e604a7aa7052565ac26c957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:18.346535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.347141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.349256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1057/2102] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:18 2022] DELETE /identity/v3/projects/39155d728e604a7aa7052565ac26c957 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:18.350046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.354485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.441722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05a606-3e95-42ea-90db-82c1e0c3e294 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.445550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c45e2-b429-4526-9812-041eff0fb33f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.447749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.448972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.448972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.449184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.449966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.451639 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b45968-af8c-44f3-95f7-94d36c7943a8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.452438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.453013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.453397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.454328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] PATH_INFO: `/v3/users/094d7d2c121e43899922f1becbe14cc6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.455069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094d7d2c121e43899922f1becbe14cc6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.457230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.463588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1058/2103] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:18.465043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.465348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.465624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.492324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:18.493795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.512548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1059/2104] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:18.512548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.528532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f91c33-b809-494d-ae38-cc2164cf38e1 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.533781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.535079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.535345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.535623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] PATH_INFO: `/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1/users/c10fe4b646334d979d299580ec9f45a3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.535909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094d7d2c121e43899922f1becbe14cc6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.536742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094d7d2c121e43899922f1becbe14cc6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.538136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d39cd17820a4a519a0dd7f1ed060bf1, user_id=c10fe4b646334d979d299580ec9f45a3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.541535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86493086-d071-48d9-9e7c-a9c1c996a165 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.545456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094d7d2c121e43899922f1becbe14cc6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.553607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1060/2105] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:18 2022] PUT /identity/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1/users/c10fe4b646334d979d299580ec9f45a3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:18.556415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094d7d2c121e43899922f1becbe14cc6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.557408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-b5ffd494-4425-464c-a144-4a1c32f81c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094d7d2c121e43899922f1becbe14cc6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:18.564400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7eca-c5eb-42c5-8f63-11b142ee1240 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.564774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7eca-c5eb-42c5-8f63-11b142ee1240 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.565118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa7eca-c5eb-42c5-8f63-11b142ee1240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.581791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1046/2106] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:18 2022] DELETE /identity/v3/users/094d7d2c121e43899922f1becbe14cc6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:18.583511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.584733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.585567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.598373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cbaa7eca-c5eb-42c5-8f63-11b142ee1240 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:18.600275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cbaa7eca-c5eb-42c5-8f63-11b142ee1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.607157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:18.616676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] MFA Rules not processed for user `c10fe4b646334d979d299580ec9f45a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:18.618649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.669478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1061/2107] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:18.673839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.674209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.674990 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.683213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:18.700774 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1047/2108] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:18.701384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:18.702513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.712547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.724482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c71b0-c546-4e85-bc61-f3f9a709c720 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.725602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1062/2109] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:18.726629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.728150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.733917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.735315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.736090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.736615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.737739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:18.738391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.742041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.770713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1048/2110] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:18.770713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.786557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.806667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780e0f8-863c-4728-ba2b-51a1bf1ac901 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.813004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.813662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.814023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.814370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.816349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:18.915943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d3650-63fa-4f2a-9986-0037b3bcf862 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.920343 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.922160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.922467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.922758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.924320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.926058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.934926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.936414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:18.937622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1063/2111] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:18.938329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:18.948531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1049/2112] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:18.950999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899880-3038-4f5e-bc26-cd3fff0fb354 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:18.956976 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:18.957755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:18.958148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:18.958534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:18.959361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:18.961894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.010184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1064/2113] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:19.012088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.026611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142dc35-062f-4547-8ff1-bea6d4f8a96d service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.167367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.186703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.187000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.187390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.188262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.190589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.237632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1050/2114] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:19 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:19.241940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.270833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ef51-d2ce-4915-b850-9e1bbd993193 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.287490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.289471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.289770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.290109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.292864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.294920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.354655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1065/2115] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:19.356519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.372489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d021c95-ffba-4fd2-9cc7-5bd0b6f6807c admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.404697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.405628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.405929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.406216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.407133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.411240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.418529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.423046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:19.458640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3b31c-ffae-4209-b8f5-1698f335b1bd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.466751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1051/2116] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:19.471610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.474737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.481144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.481582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.482848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] PATH_INFO: `/v3/projects/539e771de1884aa58f4e53f9b7e58a2c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.503134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539e771de1884aa58f4e53f9b7e58a2c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.514982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.531282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:19.545857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2108b-d22d-4bbe-b2c1-b451a1d00e4d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.559912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.560909 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.561204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.561489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] PATH_INFO: `/v3/projects/2f4ebdd243744d379ebf18906f75f623/users/3fb3a18d5f0d46db8538f77776005540/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.600708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4ebdd243744d379ebf18906f75f623, user_id=3fb3a18d5f0d46db8538f77776005540, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.603400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c92e2-0ed7-4b2c-8dd1-d9ebd6b3c25a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.613157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539e771de1884aa58f4e53f9b7e58a2c', 'request_id': 'req-c36fb1de-f477-421f-9ac0-fa73e75518a1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.623885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539e771de1884aa58f4e53f9b7e58a2c', 'request_id': 'req-c36fb1de-f477-421f-9ac0-fa73e75518a1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.636430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1052/2117] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:19 2022] PUT /identity/v3/projects/2f4ebdd243744d379ebf18906f75f623/users/3fb3a18d5f0d46db8538f77776005540/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:19.639762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539e771de1884aa58f4e53f9b7e58a2c', 'request_id': 'req-c36fb1de-f477-421f-9ac0-fa73e75518a1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.641324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6714817-873a-40ff-8432-403776f4167a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.641713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6714817-873a-40ff-8432-403776f4167a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.642057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6714817-873a-40ff-8432-403776f4167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.653407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] The token cache is being invalidate because project 539e771de1884aa58f4e53f9b7e58a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:19.653961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.654841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.656955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1066/2118] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:19 2022] DELETE /identity/v3/projects/539e771de1884aa58f4e53f9b7e58a2c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:19.661392 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.663104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:19.667072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e6714817-873a-40ff-8432-403776f4167a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:19.668405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e6714817-873a-40ff-8432-403776f4167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:19.669074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:19.736794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb1de-f477-421f-9ac0-fa73e75518a1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.748318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1053/2119] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:19.757268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6714817-873a-40ff-8432-403776f4167a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:19.758677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e6714817-873a-40ff-8432-403776f4167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:19.810242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.811412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.811699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.811998 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] PATH_INFO: `/v3/users/e3ac4ef0365345d398c16c0ae77d4fbe` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.814326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ac4ef0365345d398c16c0ae77d4fbe)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.816288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.825982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6714817-873a-40ff-8432-403776f4167a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:19.830142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:19.830978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:19.831700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:19.832162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:19.843827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:19.845448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:19.858893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1054/2120] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:19.887323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ac4ef0365345d398c16c0ae77d4fbe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.898151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ac4ef0365345d398c16c0ae77d4fbe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.898943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ac4ef0365345d398c16c0ae77d4fbe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.907444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ac4ef0365345d398c16c0ae77d4fbe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.908323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-6bcf19ac-4701-42d0-ac68-5f10a247f5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ac4ef0365345d398c16c0ae77d4fbe'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:19.927930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1067/2121] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:19 2022] DELETE /identity/v3/users/e3ac4ef0365345d398c16c0ae77d4fbe => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:20.909277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:20.910883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.044003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af018f-dc0d-4aec-a680-38ba414b3882 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.128955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.128955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.128955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.137271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:21.169186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.169715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.170708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.171065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.175826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.194230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] MFA Rules not processed for user `3fb3a18d5f0d46db8538f77776005540`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:21.196317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.219101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:21.307843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1068/2122] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:21.309098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.310713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.314282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.324653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.338678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1055/2123] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:21.339739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.341467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.403657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0afe2-72e0-4f29-9212-da68ac32dec4 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.419415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.429657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.429657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.429657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] PATH_INFO: `/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.430681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ad1e8b32814a5f94b72f14c8ebbf7a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.437183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.439260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0fbe9-4c97-4d57-9ace-c8bbd835de6c service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.448301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.449313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.450170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.450744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.451602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.454042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.484808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1056/2124] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:21.488740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.496738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ad1e8b32814a5f94b72f14c8ebbf7a', 'request_id': 'req-7ca899c7-acc9-4f96-aa90-accde787fd36'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:21.505468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ad1e8b32814a5f94b72f14c8ebbf7a', 'request_id': 'req-7ca899c7-acc9-4f96-aa90-accde787fd36'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:21.515040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ad1e8b32814a5f94b72f14c8ebbf7a', 'request_id': 'req-7ca899c7-acc9-4f96-aa90-accde787fd36'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:21.530689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] The token cache is being invalidate because project 41ad1e8b32814a5f94b72f14c8ebbf7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:21.531210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:21.532378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7ca899c7-acc9-4f96-aa90-accde787fd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:21.535611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1069/2125] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:21 2022] DELETE /identity/v3/projects/41ad1e8b32814a5f94b72f14c8ebbf7a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:21.541349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10473f8-fe79-44c5-b869-5e392ebf1d64 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.542065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10473f8-fe79-44c5-b869-5e392ebf1d64 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.542432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10473f8-fe79-44c5-b869-5e392ebf1d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.564675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d10473f8-fe79-44c5-b869-5e392ebf1d64 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:21.566212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d10473f8-fe79-44c5-b869-5e392ebf1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.574595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c328a-735e-4650-9091-7658d178d096 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.576433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1070/2126] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:21.583870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.584408 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.591031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.591169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.591169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.591169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.591169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.591523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.591523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.629221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1057/2127] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:21.631196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:21.632627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.633090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.638411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:21.644932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1071/2128] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:21.652882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.658407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c7bf9-c717-444c-8cc6-9a3e0284fd59 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.662572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36cbe-bc66-47e8-9f15-e65a50eed6fa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.664867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.665828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.666226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.666587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.667619 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.669486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.669637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.670441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.670900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.671183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.671932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:21.672268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.672664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:21.673858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.689042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1058/2129] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:21.690510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.698485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1072/2130] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:21.700377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.703522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761b410-a235-4cf7-9893-c3d26e7380de admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.710244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.711418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.711871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.712169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] PATH_INFO: `/v3/projects/84fcb343c6684fdbbcea81c97c9591fe/users/142d5cc9f2f94d19b78b86163f8bc407/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.713642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b0734-9632-433a-b358-47338244bf2a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.719514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.720316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.720604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.720883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.721579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.723592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.730244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fcb343c6684fdbbcea81c97c9591fe, user_id=142d5cc9f2f94d19b78b86163f8bc407, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.733318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.751753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1059/2131] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:21 2022] PUT /identity/v3/projects/84fcb343c6684fdbbcea81c97c9591fe/users/142d5cc9f2f94d19b78b86163f8bc407/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:21.752786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.758148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:21.772766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1073/2132] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/projects => generated 359 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:21.774518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.835649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612787cb-cc83-4d8f-9305-0d9d8cbe8d4b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.869171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2adb90-a3ec-4e17-899e-cfcc017dbd12 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.875253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.876066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.876365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.876638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.877757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.879728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.908003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1074/2133] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:21 2022] POST /identity/v3/users => generated 280 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:21.911585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.912079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.912815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.913026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.913306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.914080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.915622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.926923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1060/2134] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:21.928015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616783f-304b-4ce5-813f-0c9e103364dc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.931020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.934332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.935002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.935290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.935574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.936358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.938072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.942061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdfb89-0713-45c2-9140-2aba74505620 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:21.946693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:21.948756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:21.949039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:21.949319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] PATH_INFO: `/v3/projects/84fcb343c6684fdbbcea81c97c9591fe/users/142d5cc9f2f94d19b78b86163f8bc407/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:21.952439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1075/2135] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:21.952575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fcb343c6684fdbbcea81c97c9591fe, user_id=142d5cc9f2f94d19b78b86163f8bc407, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:21.954356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:21.958767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:21.966049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1061/2136] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:21 2022] PUT /identity/v3/projects/84fcb343c6684fdbbcea81c97c9591fe/users/142d5cc9f2f94d19b78b86163f8bc407/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:21.969553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3638bb1-f254-4b53-ba1a-1d262c7e40ad admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:22.045806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:22.046557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.046923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.047215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.047986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:22.049866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:22.065283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1076/2137] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:22.066433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:22.087656 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8723d9-3815-418a-9443-124b171ad75f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:22.093245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:22.094857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:22.097403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.101701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.105701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.107469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] PATH_INFO: `/v3/projects/ce22cb3df134492499fe8dc90f01e45d/users/e736d16073944e0c80767f27ee583186/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.130630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce22cb3df134492499fe8dc90f01e45d, user_id=e736d16073944e0c80767f27ee583186, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:22.135112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8d47-5f84-40b2-a647-6f6154d09602 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:22.162891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1062/2138] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:22 2022] PUT /identity/v3/projects/ce22cb3df134492499fe8dc90f01e45d/users/e736d16073944e0c80767f27ee583186/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:22.176689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.177012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.179981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.204078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e4820-008b-4e93-a41d-24c998d26eac admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:22.226553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] MFA Rules not processed for user `e736d16073944e0c80767f27ee583186`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:22.228069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.243300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:22.265429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:22.290268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:22.290930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.291761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.293127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.295737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.355144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1063/2139] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:22.385083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:22.386613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:22.398505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1077/2140] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:22.413178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:22.415041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.428905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87003816-f4fe-40d3-8ce1-e60a06f6aa0e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:22.448508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:22.450425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.451337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.452092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.483412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:22.485509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8892556-317a-4fd4-8326-68ffbc594252 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:22.499936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1064/2141] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:22.514526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:22.656520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc71dd-db44-4289-a343-b12cea2ec2af service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:22.663474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:22.665052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.665338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.665617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] PATH_INFO: `/v3/users/e736d16073944e0c80767f27ee583186` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.667634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e736d16073944e0c80767f27ee583186)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:22.669828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:22.734680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e736d16073944e0c80767f27ee583186'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:22.743697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e736d16073944e0c80767f27ee583186'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:22.744522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e736d16073944e0c80767f27ee583186'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:22.755105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e736d16073944e0c80767f27ee583186'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:22.755884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e736d16073944e0c80767f27ee583186'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:22.779799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:22.785709 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1078/2142] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:22 2022] DELETE /identity/v3/users/e736d16073944e0c80767f27ee583186 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:22.790185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c054b-c2b4-4221-935d-56c3f0f9dbc1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.790868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c054b-c2b4-4221-935d-56c3f0f9dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.791207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c054b-c2b4-4221-935d-56c3f0f9dbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.811114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c16c054b-c2b4-4221-935d-56c3f0f9dbc1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:22.812390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c16c054b-c2b4-4221-935d-56c3f0f9dbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.883903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1065/2143] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:22.897248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:22.898961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:22.971123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:22.972110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:22.973092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:22.998274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ae830-f592-4f20-b06b-cbbc2be00bd6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.003430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.004131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.004427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.004766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.011911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] MFA Rules not processed for user `142d5cc9f2f94d19b78b86163f8bc407`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:23.014226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.016378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.018222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5b8da-6fe2-4015-ac1b-3f3573837c82 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:23.032520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1079/2144] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:23.145298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1066/2145] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:23.147720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.148047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.148335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.176316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] MFA Rules not processed for user `3fb3a18d5f0d46db8538f77776005540`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:23.177867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.265751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1080/2146] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:23.279405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:23.285040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.338553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:23.370547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfccdeb-2087-4ca2-b434-74a2eda39c88 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.376649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.377316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.377634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.377913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.380661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.395259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:23.396903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.414693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380c421-3c97-4d27-8bb1-d261d23b4a66 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.417712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.419362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d629-ba83-4a59-9004-f426654abd16 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:23.427028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.428035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.428329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.428612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] PATH_INFO: `/v3/projects/ce22cb3df134492499fe8dc90f01e45d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.430070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce22cb3df134492499fe8dc90f01e45d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.433276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:23.449980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1067/2147] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:23.511465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce22cb3df134492499fe8dc90f01e45d', 'request_id': 'req-c940511f-becb-4b22-839d-c060ce0598cd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:23.522221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce22cb3df134492499fe8dc90f01e45d', 'request_id': 'req-c940511f-becb-4b22-839d-c060ce0598cd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:23.529177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce22cb3df134492499fe8dc90f01e45d', 'request_id': 'req-c940511f-becb-4b22-839d-c060ce0598cd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:23.544695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] The token cache is being invalidate because project ce22cb3df134492499fe8dc90f01e45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:23.545472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:23.545997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c940511f-becb-4b22-839d-c060ce0598cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:23.548811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1081/2148] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:23 2022] DELETE /identity/v3/projects/ce22cb3df134492499fe8dc90f01e45d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:23.553836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.554409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.554701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.581269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:23.582669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.676819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1068/2149] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:23.685413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.685825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.686005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.712864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:23.714404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:23.727548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:23.733187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1082/2150] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:23.740887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0840b-c7cd-46a1-835e-94b1448ce7a3 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.749945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.750859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.751987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.751987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.752896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:23.752896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.754436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:23.774927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:23.780951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1069/2151] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:11:23.796634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42634e4-eee5-4153-89fe-862a82dec4de None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.810217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.811001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.811846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.812280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.813111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.815611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:23.863230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1083/2152] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:23.868103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:23.903340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc284c-dac3-43cb-b0b5-2999c0020976 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:23.989018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:23.990747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:23.991258 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:23.991609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:23.992690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:23.995198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.024124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1070/2153] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:23 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:24.027544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.035010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:24.041745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994e39-eaf2-48b3-9d39-5e24e70c4182 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.050089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.050868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.051231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.051686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.052692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.057396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.071691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1084/2154] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:24.076594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.092812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d78396-4a38-45c6-8262-98880e5b335e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.105965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.106726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.107022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.107359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.108178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.110567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08be52-41f5-4f35-b8bd-d7487c2c6b76 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.144451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1071/2155] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:24.146507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.159788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bbac9-faa6-4406-9dd3-f0c9860e443e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.166104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.167636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.168005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.168287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] PATH_INFO: `/v3/projects/f5f165676b4a4c9191424c682c6b9687/users/9d5f88e4c74a43bf9b201531c756c145/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.185353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f165676b4a4c9191424c682c6b9687, user_id=9d5f88e4c74a43bf9b201531c756c145, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.188021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.214706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1085/2156] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:24 2022] PUT /identity/v3/projects/f5f165676b4a4c9191424c682c6b9687/users/9d5f88e4c74a43bf9b201531c756c145/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:24.217227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.217765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.218214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.252934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] MFA Rules not processed for user `9d5f88e4c74a43bf9b201531c756c145`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:24.254538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:24.290190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:24.349388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1072/2157] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:24.353684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.454263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8290c58-1ecb-40c0-8dfc-26690f117915 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.460164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.460924 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.461290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.461648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.462446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.465120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.509179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1086/2158] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:24.514860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.546450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcb138-0bb5-449c-8cbb-76875e38ec7f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.680685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.681483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.682951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.683430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.684265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.687579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.737020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1073/2159] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:24 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:24.747231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.763168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3cb9d-22e8-4d47-a5b8-4c0832d22edc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.771127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.771858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.772248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.772548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.774742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.780323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.797774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1087/2160] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:24.802153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.819367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e0c05-64a0-4ea1-a340-faddbad65750 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.826528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.827503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.827946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.828439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.829430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.831370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15c23e-ea5b-4f76-8a6d-53756c8ee6fa admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.848780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:24.858723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1074/2161] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:24.862984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916ac5f-9c72-4609-b888-b2658bd1e7c1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:24.867867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:24.868885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.869180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.870061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] PATH_INFO: `/v3/projects/fc3fe1630ba94a47a719f933c9a6021a/users/623e8ce12a15466bb4b621dd147ce07c/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.894452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3fe1630ba94a47a719f933c9a6021a, user_id=623e8ce12a15466bb4b621dd147ce07c, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:24.897270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:24.927247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:24.927553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:24.927904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:24.942559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1088/2162] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:24 2022] PUT /identity/v3/projects/fc3fe1630ba94a47a719f933c9a6021a/users/623e8ce12a15466bb4b621dd147ce07c/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:24.987552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] MFA Rules not processed for user `623e8ce12a15466bb4b621dd147ce07c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:24.988823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:25.168522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1075/2163] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:25.173136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:25.374666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87cde6-a733-4999-adcc-8d7adea1e9cd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:25.380249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:25.381066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:25.381508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:25.381794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:25.382514 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:25.393748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:25.499283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:25.499661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1089/2164] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:25 2022] POST /identity/v3/projects => generated 381 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:25.524663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a117e-0ed0-479b-b30e-394738bdeda1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:25.597695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:25.666525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:25.667638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:25.668688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:25.669225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:25.670210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:25.672760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:25.719005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1076/2165] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:25 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:25.722729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:25.728229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:25.737204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47547-782b-406e-b647-db3cde78c405 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:25.745702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:25.746661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:25.747141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:25.747607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:25.748573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:25.751126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:25.767629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1090/2166] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:25.771812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:25.783610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56f337-3acc-4727-b1de-e0b1d254abc8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:25.789605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:25.790694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:25.792230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:25.792631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] PATH_INFO: `/v3/projects/dc844d68482d42f1a9824e373db0af49/users/162917bd391e4f499eb0a602b76b503d/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:25.860504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc844d68482d42f1a9824e373db0af49, user_id=162917bd391e4f499eb0a602b76b503d, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:25.863194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:25.894033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1077/2167] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:25 2022] PUT /identity/v3/projects/dc844d68482d42f1a9824e373db0af49/users/162917bd391e4f499eb0a602b76b503d/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:25.901292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:25.934358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c36f17-b835-4e9f-a8fc-8a3df1eec52d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:26.042155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:26.047235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:26.047235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:26.047235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:26.047235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:26.047235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5361c-2bac-4080-8f5e-dc0e9ed6006a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:26.061413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1091/2168] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:26.065760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:26.089492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60b04d-1fd7-461a-98a9-ce415db529f2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:26.101203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:26.104988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:26.105503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:26.106607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] PATH_INFO: `/v3/projects/dc844d68482d42f1a9824e373db0af49/users/162917bd391e4f499eb0a602b76b503d/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:26.111000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc844d68482d42f1a9824e373db0af49, user_id=162917bd391e4f499eb0a602b76b503d, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:26.115071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:26.142542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1078/2169] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:26 2022] PUT /identity/v3/projects/dc844d68482d42f1a9824e373db0af49/users/162917bd391e4f499eb0a602b76b503d/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:26.145767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:26.146111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:26.146440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:26.188986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] MFA Rules not processed for user `162917bd391e4f499eb0a602b76b503d`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:26.190255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:26.283094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1092/2170] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:26.295808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:26.298037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:26.364087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5e30-7d84-407c-90e5-11d6b13194eb admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:26.367933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:26.368659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:26.368948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:26.369273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:26.434669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:26.435507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc71d-61c0-4f10-9d93-9ddb15160e9d service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:26.446912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1079/2171] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:27.101698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:27.104225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:27.223004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f04ed-825f-4039-a52c-1e17617a1f95 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:27.230648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:27.233429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:27.233741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:27.234059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] PATH_INFO: `/v3/users/1b2c0597381c4e27a21ff56c008fb82f` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:27.240606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2c0597381c4e27a21ff56c008fb82f)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:27.244752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:27.277991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:27.319622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2c0597381c4e27a21ff56c008fb82f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:27.328942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2c0597381c4e27a21ff56c008fb82f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:27.330564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2c0597381c4e27a21ff56c008fb82f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:27.342241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2c0597381c4e27a21ff56c008fb82f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:27.343662 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2c0597381c4e27a21ff56c008fb82f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:27.378644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1093/2172] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:27 2022] DELETE /identity/v3/users/1b2c0597381c4e27a21ff56c008fb82f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:27.383093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75010d-a234-43df-8347-3165652916c1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:27.383572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75010d-a234-43df-8347-3165652916c1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:27.383744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75010d-a234-43df-8347-3165652916c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:27.405087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ec75010d-a234-43df-8347-3165652916c1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:27.406584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ec75010d-a234-43df-8347-3165652916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:27.444316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:27.483346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1080/2173] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:27.493886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:27.495424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:27.561192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd322dd-d648-4f63-be00-33cebaf3fca1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:27.565016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:27.566075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:27.566387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:27.566679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:27.578032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:27.579507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:27.597327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1094/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:27.946203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75010d-a234-43df-8347-3165652916c1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:27.948707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ec75010d-a234-43df-8347-3165652916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:27.963883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75010d-a234-43df-8347-3165652916c1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:27.977974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:27.979430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:27.979829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:27.980026 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] PATH_INFO: `/v3/projects/0e47670aec264cf79292e12b33cea654` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:27.984123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e47670aec264cf79292e12b33cea654)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:27.987048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:28.078332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e47670aec264cf79292e12b33cea654', 'request_id': 'req-519c68f1-0efd-4a6b-8274-02925d3860e5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.086861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e47670aec264cf79292e12b33cea654', 'request_id': 'req-519c68f1-0efd-4a6b-8274-02925d3860e5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.100211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e47670aec264cf79292e12b33cea654', 'request_id': 'req-519c68f1-0efd-4a6b-8274-02925d3860e5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.143161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] The token cache is being invalidate because project 0e47670aec264cf79292e12b33cea654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:28.143459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.144185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.146072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1081/2175] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:27 2022] DELETE /identity/v3/projects/0e47670aec264cf79292e12b33cea654 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:28.149856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:28.164841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd0a72-8243-4926-b71a-c8c24b8201af service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:28.306233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:28.307698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:28.308013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:28.308433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] PATH_INFO: `/v3/users/7c2b53b9bd2c4f9288df58c0750f9413` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:28.311071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2b53b9bd2c4f9288df58c0750f9413)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:28.312129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:28.314281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:28.315746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:28.393176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:28.419688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c68f1-0efd-4a6b-8274-02925d3860e5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:28.431201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:28.433099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:28.433393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:28.434092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:28.437446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:28.440586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2b53b9bd2c4f9288df58c0750f9413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.464496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2b53b9bd2c4f9288df58c0750f9413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.468448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2b53b9bd2c4f9288df58c0750f9413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.498587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2b53b9bd2c4f9288df58c0750f9413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.499633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2b53b9bd2c4f9288df58c0750f9413'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:28.562504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1095/2176] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:28 2022] DELETE /identity/v3/users/7c2b53b9bd2c4f9288df58c0750f9413 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:28.596778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:28.598257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:28.612057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1082/2177] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:29.107291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:29.109810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:29.204777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0348-4bb9-4efd-a530-a7c066cc3553 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:29.216668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:29.218244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:29.219220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:29.219694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] PATH_INFO: `/v3/projects/791aaab2893b42bf865568631727e439` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:29.221549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] RBAC: Authorizing `identity:delete_project(project_id=791aaab2893b42bf865568631727e439)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:29.223868 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:29.281559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791aaab2893b42bf865568631727e439', 'request_id': 'req-86a28ec7-6678-4eaa-9b25-744116e6545a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.290175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791aaab2893b42bf865568631727e439', 'request_id': 'req-86a28ec7-6678-4eaa-9b25-744116e6545a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.296599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791aaab2893b42bf865568631727e439', 'request_id': 'req-86a28ec7-6678-4eaa-9b25-744116e6545a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.308219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] The token cache is being invalidate because project 791aaab2893b42bf865568631727e439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:29.308513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.309166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.311113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1096/2178] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:29 2022] DELETE /identity/v3/projects/791aaab2893b42bf865568631727e439 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:29.314828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:29.316246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:29.331036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370bc9c-0ecc-47b4-81e0-1876d17ee34b service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:29.343083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:29.392296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:29.393822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:29.396963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:29.398081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:29.398414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:29.398724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] PATH_INFO: `/v3/users/c10fe4b646334d979d299580ec9f45a3` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:29.400423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10fe4b646334d979d299580ec9f45a3)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:29.402945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:29.457130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:29.463266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10fe4b646334d979d299580ec9f45a3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.464058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10fe4b646334d979d299580ec9f45a3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.470104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a28ec7-6678-4eaa-9b25-744116e6545a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:29.471797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10fe4b646334d979d299580ec9f45a3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.475161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:29.475817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:29.476141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:29.476429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:29.479350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:29.481139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10fe4b646334d979d299580ec9f45a3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.482164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10fe4b646334d979d299580ec9f45a3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.502968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1083/2179] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:29 2022] DELETE /identity/v3/users/c10fe4b646334d979d299580ec9f45a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:29.555277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:29.557549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd7f6-5a87-4b45-9893-ac43e74b5ca0 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:29.567413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1097/2180] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:29.802353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:29.803855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:29.904536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560dd06-791c-4d16-baff-1e37307275f9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:29.910577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:29.911543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:29.911838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:29.912409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] PATH_INFO: `/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:29.913531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d39cd17820a4a519a0dd7f1ed060bf1)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:29.915679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:29.965053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:29.977802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d39cd17820a4a519a0dd7f1ed060bf1', 'request_id': 'req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.985010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d39cd17820a4a519a0dd7f1ed060bf1', 'request_id': 'req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:29.993985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d39cd17820a4a519a0dd7f1ed060bf1', 'request_id': 'req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:30.005986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] The token cache is being invalidate because project 5d39cd17820a4a519a0dd7f1ed060bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:30.006272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:30.006925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-67041c0e-2ea2-4bb7-a0f2-105c2cc1e17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:30.009384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1084/2181] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:29 2022] DELETE /identity/v3/projects/5d39cd17820a4a519a0dd7f1ed060bf1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:30.014581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.014950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.015323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.035783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:30.037201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:30.106908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1098/2182] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:30.114602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.114969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.115348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.133533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:30.134755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:30.143080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1085/2183] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:30.147578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.158399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9bd8-8352-402b-a362-5083a3588ad9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.165289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.166854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.167136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.167411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.168471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:30.168471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.177797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.186475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1099/2184] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:30.190923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.200658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c85513-19f5-4544-8b40-7e0726c31bec None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.205381 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.206034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.206324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.206607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.207318 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.209247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.247927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1086/2185] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:30.248518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.265186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db62bb5-5cb4-4658-b6d3-f9863cb31f9a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.326631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.327301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.327590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.327865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.328719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.330920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.355541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1100/2186] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:30 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:30.359316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.371767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59730b-9d60-4684-a54f-a121fb57eb63 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.376780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.377453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.377741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.378022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.378794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.380446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.396871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1087/2187] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:30.401961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.413164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4151125-8821-43bf-9b01-aaebe76bbcc2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.421254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.421954 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.422749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.423045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.423917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.425597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be63b-d988-41e3-8f49-92d0c6fe0b6a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.431256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:30.442982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.443525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1101/2188] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:30.454577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c83d2-5f1c-4f55-9fa1-334c834ec670 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.463759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.465471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.465901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.466445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] PATH_INFO: `/v3/projects/ace31bfab51641f09cc01825b5a9874f/users/c5a453c65c0d4af391207d936b3ed058/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.481956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace31bfab51641f09cc01825b5a9874f, user_id=c5a453c65c0d4af391207d936b3ed058, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.484852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.501521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1088/2189] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:30 2022] PUT /identity/v3/projects/ace31bfab51641f09cc01825b5a9874f/users/c5a453c65c0d4af391207d936b3ed058/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:30.513276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.513505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.513781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.541485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] MFA Rules not processed for user `c5a453c65c0d4af391207d936b3ed058`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:30.542723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:30.618920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1102/2190] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:30.630822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:30.632689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:30.693041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fb27-07e5-4911-b4ba-62585b7da1f9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:30.696936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:30.698476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:30.698764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:30.699044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:30.714067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:30.715579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00e0de-573b-4983-9bfa-52a8054f7fe6 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:30.726032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1089/2191] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:33.857308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:33.859668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:33.942686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b133-a417-467c-94e3-bfb895f19f31 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:33.949102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:33.953313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:33.953861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:33.954159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] PATH_INFO: `/v3/users/9d5f88e4c74a43bf9b201531c756c145` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:33.957840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5f88e4c74a43bf9b201531c756c145)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:33.959866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:34.115704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5f88e4c74a43bf9b201531c756c145'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.131752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5f88e4c74a43bf9b201531c756c145'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.132720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5f88e4c74a43bf9b201531c756c145'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.154115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5f88e4c74a43bf9b201531c756c145'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.154814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5f88e4c74a43bf9b201531c756c145'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.192239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1103/2192] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:33 2022] DELETE /identity/v3/users/9d5f88e4c74a43bf9b201531c756c145 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:34.198339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ea8a-bf75-4eb4-8237-ba4d6867f963 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.198831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ea8a-bf75-4eb4-8237-ba4d6867f963 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.198910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ea8a-bf75-4eb4-8237-ba4d6867f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.220848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2343ea8a-bf75-4eb4-8237-ba4d6867f963 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:34.222081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2343ea8a-bf75-4eb4-8237-ba4d6867f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.328686 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1090/2193] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:34.340621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:34.342271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.358030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:34.457386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d71fb-ec22-4ddd-8dad-c1656882e067 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:34.463835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:34.464781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.465088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.465373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.489213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:34.490831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6d9f9-3909-4bc9-ad15-9c21efbf5d88 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:34.506674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1104/2194] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:34.694762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.695288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.695706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.697760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1091/2195] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:11:34.705302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.705712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.706109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.734182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:34.736182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.808280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:34.810031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.814684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1105/2196] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:34.831044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:34.831509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:34.834825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.840929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0bfbd-5a23-4012-ba1e-214feea19645 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:34.848487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:34.849379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae591f45-6eae-4972-8a1d-defe59e21d93 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:34.850408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.851096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.851378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] PATH_INFO: `/v3/users/e60614620eb847f79fb6abbf33f47c2e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.852645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60614620eb847f79fb6abbf33f47c2e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:34.854829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:34.854958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:34.855601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:34.855899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:34.856223 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:34.868872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:34.870603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:34.894849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1106/2197] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:34.927775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60614620eb847f79fb6abbf33f47c2e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.928486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60614620eb847f79fb6abbf33f47c2e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.936560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60614620eb847f79fb6abbf33f47c2e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.944226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60614620eb847f79fb6abbf33f47c2e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.944865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60614620eb847f79fb6abbf33f47c2e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:34.969013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:34.971159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:34.976221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1092/2198] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:34 2022] DELETE /identity/v3/users/e60614620eb847f79fb6abbf33f47c2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:34.986669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee337c-311c-43d5-b922-742aeab8e1ea service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.051413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.052938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.053299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.053652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] PATH_INFO: `/v3/projects/f5f165676b4a4c9191424c682c6b9687` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.055286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f165676b4a4c9191424c682c6b9687)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.058421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.107586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:35.123851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f165676b4a4c9191424c682c6b9687', 'request_id': 'req-8bfddb76-9fcf-4b43-9b87-8c44a0214512'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.131899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f165676b4a4c9191424c682c6b9687', 'request_id': 'req-8bfddb76-9fcf-4b43-9b87-8c44a0214512'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.139187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f165676b4a4c9191424c682c6b9687', 'request_id': 'req-8bfddb76-9fcf-4b43-9b87-8c44a0214512'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.154232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] The token cache is being invalidate because project f5f165676b4a4c9191424c682c6b9687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:35.154529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.155215 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.160163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1107/2199] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:34 2022] DELETE /identity/v3/projects/f5f165676b4a4c9191424c682c6b9687 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:35.161683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.163479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.173631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.175578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.185446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86aab-0896-4f51-bea4-6300afe2d9ef admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.255317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.256018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddb76-9fcf-4b43-9b87-8c44a0214512 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.256235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.256527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.256804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] PATH_INFO: `/v3/users/623e8ce12a15466bb4b621dd147ce07c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.257988 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] RBAC: Authorizing `identity:delete_user(user_id=623e8ce12a15466bb4b621dd147ce07c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.260962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.261378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.262235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.262528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.262809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] PATH_INFO: `/v3/projects/68ace7ee10c54aff8992bcf6ce7dbf28` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.264053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ace7ee10c54aff8992bcf6ce7dbf28)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.265959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.314561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623e8ce12a15466bb4b621dd147ce07c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.315198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623e8ce12a15466bb4b621dd147ce07c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.323807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623e8ce12a15466bb4b621dd147ce07c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.329938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ace7ee10c54aff8992bcf6ce7dbf28', 'request_id': 'req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.333577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623e8ce12a15466bb4b621dd147ce07c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.334328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-940859e8-cfe7-4654-a3f8-a577acfe527e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623e8ce12a15466bb4b621dd147ce07c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.339743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ace7ee10c54aff8992bcf6ce7dbf28', 'request_id': 'req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.346047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ace7ee10c54aff8992bcf6ce7dbf28', 'request_id': 'req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.348994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:35.357248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1093/2200] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:35 2022] DELETE /identity/v3/users/623e8ce12a15466bb4b621dd147ce07c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:35.359571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] The token cache is being invalidate because project 68ace7ee10c54aff8992bcf6ce7dbf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:35.360053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.361094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d1f4abcb-63e4-45b2-8814-cfb7a79d3cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.362911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1108/2201] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:35 2022] DELETE /identity/v3/projects/68ace7ee10c54aff8992bcf6ce7dbf28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:35.367760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.368184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.368538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.392163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:35.393394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.481109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1094/2202] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:35.488255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.488556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.488825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.511809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:35.513205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.523521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1109/2203] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:35.529076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.539244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb64e8-87c8-4982-8b00-d3907f10583d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.544912 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.545570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.545944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.546240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.546962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:35.547299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.549028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.564842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1095/2204] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:35.566310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.575874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bf990-14a2-4816-b973-3f5dfddc65e8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.580604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.581268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.581554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.581833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.582537 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.584484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.621098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1110/2205] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:35 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:35.625470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.637014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80fd7-988b-4bb7-938f-fb3e8ef770c5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.661595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.663571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.711179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.711299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.711560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.711842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.712589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.714545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.728174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:35.740496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1096/2206] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:35 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:35.745866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.760176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c77d8-ab5e-49a7-9286-deb09f410cee admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.768296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.769196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.769613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.770235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.771079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.772837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.782147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d5938-5a80-4891-a9fc-6a35a58f87a0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.784470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1097/2207] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:35.788446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.788535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.789960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.790316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.790665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] PATH_INFO: `/v3/projects/fc3fe1630ba94a47a719f933c9a6021a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.795824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3fe1630ba94a47a719f933c9a6021a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.797693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.799391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1c71-ba23-4bf0-bee1-39bd4b3931fc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.805426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.807101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.807226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.807545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.808389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.810135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.823867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1098/2208] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:35.827835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.839716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40a96-9b25-4e39-bccf-71d25109a749 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:35.847882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:35.848893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.849261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.849609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] PATH_INFO: `/v3/projects/527bfb374cc64e368f86dd7a5798f8c0/users/74912c5638214dd1a14850d6dce13721/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.873363 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527bfb374cc64e368f86dd7a5798f8c0, user_id=74912c5638214dd1a14850d6dce13721, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:35.876153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc197c-ef38-4fed-8d01-47a0bcdf7e99 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:35.877949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3fe1630ba94a47a719f933c9a6021a', 'request_id': 'req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.886557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3fe1630ba94a47a719f933c9a6021a', 'request_id': 'req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.890631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1099/2209] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:35 2022] PUT /identity/v3/projects/527bfb374cc64e368f86dd7a5798f8c0/users/74912c5638214dd1a14850d6dce13721/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:35.894421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3fe1630ba94a47a719f933c9a6021a', 'request_id': 'req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.902653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:35.902980 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:35.903253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:35.911146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] The token cache is being invalidate because project fc3fe1630ba94a47a719f933c9a6021a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:35.911545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.912446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:35.914136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1111/2210] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:35 2022] DELETE /identity/v3/projects/fc3fe1630ba94a47a719f933c9a6021a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:35.918473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:35.919980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.941271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] MFA Rules not processed for user `74912c5638214dd1a14850d6dce13721`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:35.942529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:35.958871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:35.990438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc3077-50d3-4e5b-8822-4fc40cb8e4f7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:36.034522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1100/2211] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:36.048226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:36.049689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:36.056251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:36.057181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.057473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.057757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] PATH_INFO: `/v3/users/162917bd391e4f499eb0a602b76b503d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.058982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162917bd391e4f499eb0a602b76b503d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:36.061083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:36.066615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:36.123599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162917bd391e4f499eb0a602b76b503d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.130931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162917bd391e4f499eb0a602b76b503d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.131790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162917bd391e4f499eb0a602b76b503d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.141210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18642-d48f-4f06-a6c9-8ab10358cdfb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:36.142634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162917bd391e4f499eb0a602b76b503d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.143415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162917bd391e4f499eb0a602b76b503d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.148095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:36.148829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.149247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.149608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.152269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:36.164251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:36.164910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1112/2212] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:35 2022] DELETE /identity/v3/users/162917bd391e4f499eb0a602b76b503d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:36.168378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000cfdc-1b26-4b93-99aa-4b5e18c06c27 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:36.179018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1101/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:36.477756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:36.479338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:36.605451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5479f-fcb8-4a01-9f9b-17a602f225f1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:36.618236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:36.619859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.620237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.620745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] PATH_INFO: `/v3/projects/dc844d68482d42f1a9824e373db0af49` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.623705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc844d68482d42f1a9824e373db0af49)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:36.626095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:36.694565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc844d68482d42f1a9824e373db0af49', 'request_id': 'req-7a0bcdb1-509b-413d-905c-06435f063831'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.707358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc844d68482d42f1a9824e373db0af49', 'request_id': 'req-7a0bcdb1-509b-413d-905c-06435f063831'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.715079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc844d68482d42f1a9824e373db0af49', 'request_id': 'req-7a0bcdb1-509b-413d-905c-06435f063831'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.727792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] The token cache is being invalidate because project dc844d68482d42f1a9824e373db0af49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:36.728203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.728951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-7a0bcdb1-509b-413d-905c-06435f063831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:36.730594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1113/2214] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:36 2022] DELETE /identity/v3/projects/dc844d68482d42f1a9824e373db0af49 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:36.736101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.736556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.736772 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.760246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:36.761140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:36.823395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1102/2215] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:36.831920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.832247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.832534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.850832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:36.852085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:36.860507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1114/2216] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:36.864680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:36.874714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55557b2-8601-4149-9b40-53aa4840e3d6 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:36.879668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:36.880470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.880892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.881263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.882140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:36.882677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:36.885474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:36.904028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1103/2217] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:36.907451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:36.917246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c721d-8afa-4c7b-a324-72ff282a6ecc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:36.922849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:36.923623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:36.924040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:36.924437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:36.925239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:36.927619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:36.932304 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:36.962848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1115/2218] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:36 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:36.967008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:36.977934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652949-4537-4f06-a31e-9899cb665142 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:37.008447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:37.043702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:37.044593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.044881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.045158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.045991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:37.054240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:37.077072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1104/2219] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:36 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:37.081061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:37.091391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc597c5c-3cf3-49fe-a5e6-9368346b29b0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:37.096886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:37.097656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.098026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.098209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.099128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:37.100776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:37.112316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1116/2220] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:37.116290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:37.126798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f448395-bce6-4bbb-b581-014c47f28198 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:37.131533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:37.132224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.132511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.132795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.133655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:37.135408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ab1ef-fc74-4734-85d4-52f7e7d23c5f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:37.145367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1105/2221] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:37.149400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:37.167644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831165-6cec-434a-bb17-e87df36d21b7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:37.172876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:37.173681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.173968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.174243 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] PATH_INFO: `/v3/projects/bf33d8b18afc4fbe8b05a9b0d5f6f703/users/466b35770270477e974c61739f65c31f/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.191902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf33d8b18afc4fbe8b05a9b0d5f6f703, user_id=466b35770270477e974c61739f65c31f, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:37.194554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:37.209505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1117/2222] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:37 2022] PUT /identity/v3/projects/bf33d8b18afc4fbe8b05a9b0d5f6f703/users/466b35770270477e974c61739f65c31f/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:37.219575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.219868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.220190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.248714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] MFA Rules not processed for user `466b35770270477e974c61739f65c31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:37.250360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:37.317142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1106/2223] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:37.328771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:37.330711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:37.392849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17b95-7510-4ae4-adf5-8608607159d8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:37.399640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:37.400793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:37.401086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:37.401442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:37.411347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:37.413217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:37.422722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1118/2224] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:41.049916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:41.051425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:41.110073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001835-f6c3-4ad6-801f-9bc467770c81 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:41.113840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:41.114497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:41.114778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:41.116445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:41.116934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:41.169673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:41.185189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:41.186568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27556626-5248-4e63-a601-14b8671b96e9 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:41.196984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1107/2225] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:41.729886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:41.731343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:41.797553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea350bf1-c6f5-457a-98e5-104c72b8d70c service glance] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:41.802246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:41.803119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:41.803404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:41.803680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] PATH_INFO: `/v3/users/c5a453c65c0d4af391207d936b3ed058` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:41.804896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a453c65c0d4af391207d936b3ed058)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:41.806967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:41.858777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a453c65c0d4af391207d936b3ed058'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:41.865012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:41.867204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a453c65c0d4af391207d936b3ed058'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:41.868316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a453c65c0d4af391207d936b3ed058'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:41.878418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a453c65c0d4af391207d936b3ed058'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:41.879296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a453c65c0d4af391207d936b3ed058'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:41.898176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1119/2226] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:41 2022] DELETE /identity/v3/users/c5a453c65c0d4af391207d936b3ed058 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:41.902613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:41.902916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:41.903200 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:41.922217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:41.923601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:41.989843 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1108/2227] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:42.000421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:42.001824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:42.065596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55770-ef4b-45b9-95c2-291615168c70 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:42.071516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:42.073302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:42.073659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:42.074010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:42.084529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:42.086070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:42.096984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1120/2228] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:42.441337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:42.442906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:42.462740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7ee32-66d5-4cfa-9ee4-1f2adfcf4ce2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:42.468422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:42.469293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:42.469575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:42.469853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] PATH_INFO: `/v3/projects/ace31bfab51641f09cc01825b5a9874f` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:42.471378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace31bfab51641f09cc01825b5a9874f)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:42.473478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:42.523373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace31bfab51641f09cc01825b5a9874f', 'request_id': 'req-acfb4e27-26ac-467f-8c9b-ca61e1493867'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.532815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace31bfab51641f09cc01825b5a9874f', 'request_id': 'req-acfb4e27-26ac-467f-8c9b-ca61e1493867'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.542634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace31bfab51641f09cc01825b5a9874f', 'request_id': 'req-acfb4e27-26ac-467f-8c9b-ca61e1493867'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.554999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] The token cache is being invalidate because project ace31bfab51641f09cc01825b5a9874f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:42.555295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.555945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acfb4e27-26ac-467f-8c9b-ca61e1493867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.558149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1109/2229] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:42 2022] DELETE /identity/v3/projects/ace31bfab51641f09cc01825b5a9874f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:42.747788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:42.750054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:42.766736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30616-4a2b-48ba-aeb2-92477979ad1c service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:42.830569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:42.831469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:42.831783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:42.832193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] PATH_INFO: `/v3/users/74912c5638214dd1a14850d6dce13721` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:42.833571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74912c5638214dd1a14850d6dce13721)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:42.835507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:42.887915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74912c5638214dd1a14850d6dce13721'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.895614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74912c5638214dd1a14850d6dce13721'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.896498 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74912c5638214dd1a14850d6dce13721'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.904669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74912c5638214dd1a14850d6dce13721'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.905303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74912c5638214dd1a14850d6dce13721'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:42.917152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:42.927388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1121/2230] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:42 2022] DELETE /identity/v3/users/74912c5638214dd1a14850d6dce13721 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:42.931936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:42.932208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:42.932500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:42.951295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:42.953610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:43.017103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1110/2231] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:43.027029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.028473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:43.091254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8adf-5e16-4d78-942f-450984e6046a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.095019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.095670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.095980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.096264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.106070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.107504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4993c-c246-4f8a-baca-8b77d8d77555 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.118430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1122/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:43.413233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.415867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:43.464581 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5e36-163d-4df0-9358-e34cbe29a38d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.480501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.481382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.481660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.481936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] PATH_INFO: `/v3/projects/527bfb374cc64e368f86dd7a5798f8c0` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.483170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527bfb374cc64e368f86dd7a5798f8c0)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.485114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.492256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:43.540077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527bfb374cc64e368f86dd7a5798f8c0', 'request_id': 'req-2e1c7692-e613-44c9-8851-8789a2c6ff65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:43.546040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527bfb374cc64e368f86dd7a5798f8c0', 'request_id': 'req-2e1c7692-e613-44c9-8851-8789a2c6ff65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:43.553950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527bfb374cc64e368f86dd7a5798f8c0', 'request_id': 'req-2e1c7692-e613-44c9-8851-8789a2c6ff65'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:43.566657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] The token cache is being invalidate because project 527bfb374cc64e368f86dd7a5798f8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:43.567009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:43.567685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2e1c7692-e613-44c9-8851-8789a2c6ff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:43.569331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1111/2233] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:43 2022] DELETE /identity/v3/projects/527bfb374cc64e368f86dd7a5798f8c0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:43.575103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.575403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.575688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.593538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:43.594757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:43.655072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1123/2234] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:43.663011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.663307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.663594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.683148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:43.684411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:43.692484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1112/2235] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:43.696805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.707183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514b58a-2b83-47e2-9e14-fe170f6e6ee3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.711804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.712513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.712811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.713092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.713832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:43.714146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.715745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.727104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1124/2236] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:43.731811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.741100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb7be0-a6f7-4893-bde2-dbca0667c205 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.746684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.747331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.747618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.747900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.748641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.750556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.775486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1113/2237] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:43 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:43.779833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.790108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee955-5ba1-434d-86a2-f22f2de9c178 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.847423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.848176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.848467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.848751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.849459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.851420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.872198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1125/2238] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:43 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:43.876572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.886816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1809d-9d91-4b6e-a806-99c073d9f884 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.891453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.892147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.892437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.892730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.893458 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.895089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.905410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1114/2239] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:43.910475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.921589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c78cc-bb0a-4cf3-a386-0406781a56e5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.926197 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.926820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.927102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.927376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.928137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.929940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed47edd-d83a-439c-aa9e-a560e4512e8c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.941350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1126/2240] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:43.945883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:43.956451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab7ae-8647-468c-b7de-391cc5a50b4b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:43.961113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:43.961984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:43.962271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:43.962553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] PATH_INFO: `/v3/projects/75e937f9010e4d2ca471ae044cffef82/users/55b1ce060dc14334aef2e36cfab6c797/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:43.979929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e937f9010e4d2ca471ae044cffef82, user_id=55b1ce060dc14334aef2e36cfab6c797, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:43.983028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:43.997812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1115/2241] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:43 2022] PUT /identity/v3/projects/75e937f9010e4d2ca471ae044cffef82/users/55b1ce060dc14334aef2e36cfab6c797/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:44.008060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:44.008356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:44.008640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:44.014644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:44.046414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] MFA Rules not processed for user `55b1ce060dc14334aef2e36cfab6c797`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:44.047983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:44.118162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1127/2242] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:44.129182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:44.131041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:44.207526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f862-827e-4f31-817d-e9ad1668b60e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:44.213668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:44.214320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:44.214603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:44.214898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:44.223128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:44.224773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9ab46-b893-408d-a400-ea3843860d73 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:44.234286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1116/2243] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:44.451755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:44.562575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9a7b0-b3cb-4ea7-b803-088a644cb357 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:44.567671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:44.568972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:44.569471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:44.569948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] PATH_INFO: `/v3/users/55b1ce060dc14334aef2e36cfab6c797` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:44.572889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b1ce060dc14334aef2e36cfab6c797)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:44.575030 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:44.647140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b1ce060dc14334aef2e36cfab6c797'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:44.661866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b1ce060dc14334aef2e36cfab6c797'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:44.662750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b1ce060dc14334aef2e36cfab6c797'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:44.670964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b1ce060dc14334aef2e36cfab6c797'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:44.671681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b1ce060dc14334aef2e36cfab6c797'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:44.691856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1128/2244] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:44 2022] DELETE /identity/v3/users/55b1ce060dc14334aef2e36cfab6c797 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:44.696509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:44.697813 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:44.697897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:44.724163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:44.725408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:44.735471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:44.794480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1117/2245] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:44.804530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:44.806008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:44.822853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:44.878385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b835e-c403-4438-a959-ab90c8db36d0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:44.882084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:44.882728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:44.883012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:44.883288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:44.893793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:44.895336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe72d5c-4850-4175-8126-a154e4fa2389 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:44.907158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1129/2246] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:11:45.238643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.240163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:45.253570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e80c4-4cec-48a8-84f4-171b1fcf89f8 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.258830 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.259141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.259410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.259691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] PATH_INFO: `/v3/projects/75e937f9010e4d2ca471ae044cffef82` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.261385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e937f9010e4d2ca471ae044cffef82)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.263307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.316883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e937f9010e4d2ca471ae044cffef82', 'request_id': 'req-ea67ca24-b691-4ec7-a749-66936f0a5ba4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:45.322400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e937f9010e4d2ca471ae044cffef82', 'request_id': 'req-ea67ca24-b691-4ec7-a749-66936f0a5ba4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:45.341855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e937f9010e4d2ca471ae044cffef82', 'request_id': 'req-ea67ca24-b691-4ec7-a749-66936f0a5ba4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:45.358426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] The token cache is being invalidate because project 75e937f9010e4d2ca471ae044cffef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:45.358725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:45.359405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-ea67ca24-b691-4ec7-a749-66936f0a5ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:45.361016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1118/2247] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:45 2022] DELETE /identity/v3/projects/75e937f9010e4d2ca471ae044cffef82 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:45.367448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.367732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.368059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.386253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:45.387441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:45.448973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1130/2248] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:45.459302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824dd-215b-4f89-a568-c7d36305156d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.459597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824dd-215b-4f89-a568-c7d36305156d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.459880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254824dd-215b-4f89-a568-c7d36305156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.480513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-254824dd-215b-4f89-a568-c7d36305156d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:45.481755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-254824dd-215b-4f89-a568-c7d36305156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:45.489786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1119/2249] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:45.494794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.504562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2490848-4c71-47a8-a3c1-84b006cc492c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.509161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.509857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.510140 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.510416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.511172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:45.511482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.513120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.525234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1131/2250] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:11:45.529568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254824dd-215b-4f89-a568-c7d36305156d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.538893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254824dd-215b-4f89-a568-c7d36305156d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.544160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.544814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.545102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.545380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.546099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.548105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.581842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1120/2251] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:45 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:45.582973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.593592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5d00-eac5-4ee7-bc80-9fb82fc784ca admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.667616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.668356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.668728 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.668918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.669612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.671633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.691239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1132/2252] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:45 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:45.695883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.710214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0395f3-17f6-49e1-96f6-7bfb75f3416b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.718425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.719062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.719385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.719695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.720701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.722558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.734660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1121/2253] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:45.738735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.749098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e982c-db56-4cc8-8be6-b7b6d3f4464e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.753879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.754534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.754858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.755089 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.755812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.757988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57f67a-3c2e-4ab5-9cea-88694d357b0b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.769438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1133/2254] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:45.773308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.786215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967e4e-ecbf-4a6a-a9b7-5cbd228b84ab admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:45.791858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:45.792940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.793228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.793510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] PATH_INFO: `/v3/projects/111d3b323d9e41a3863f9108755949f7/users/002863949308421e99ed137e26a83c2d/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.808849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111d3b323d9e41a3863f9108755949f7, user_id=002863949308421e99ed137e26a83c2d, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:45.811540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:45.825657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1122/2255] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:45 2022] PUT /identity/v3/projects/111d3b323d9e41a3863f9108755949f7/users/002863949308421e99ed137e26a83c2d/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:45.835832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:45.836430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:45.836547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:45.867615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] MFA Rules not processed for user `002863949308421e99ed137e26a83c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:45.869118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:45.878316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:45.956571 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1134/2256] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:45.968332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:45.970151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:46.033925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:46.055789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f224b0-d01e-480d-856b-dd8568f61da0 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:46.059567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:46.060246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:46.060532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:46.060812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:46.069967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:46.071556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce174c-bfd2-4b54-bd91-bdbb862d5b1e service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:46.082159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1123/2257] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:49.096977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:49.169348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e777f-e93a-4d3b-81e0-f802839e5b2e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:49.173925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:49.174813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.175107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.175395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] PATH_INFO: `/v3/users/002863949308421e99ed137e26a83c2d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.176621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=002863949308421e99ed137e26a83c2d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:49.178551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:49.226958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002863949308421e99ed137e26a83c2d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.234189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002863949308421e99ed137e26a83c2d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.234849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002863949308421e99ed137e26a83c2d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.242167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002863949308421e99ed137e26a83c2d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.242819 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002863949308421e99ed137e26a83c2d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.260808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1135/2258] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:49 2022] DELETE /identity/v3/users/002863949308421e99ed137e26a83c2d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:49.265416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.266494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.266494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.285252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:49.286497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:49.345723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1124/2259] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:49.355722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:49.357157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:49.389247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:49.419538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f831c-24ba-40cf-ad88-5ed81d1ff41a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:49.423292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:49.423944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.424265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.424550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.437239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:49.438680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90392e5e-6576-4f70-8c99-6b2dcb8758d7 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:49.448797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1136/2260] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:49.744332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:49.745777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:49.760289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446b76e-073c-4d9e-9fda-75007ee3c33f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:49.766926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:49.767802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.768153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.768574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] PATH_INFO: `/v3/projects/111d3b323d9e41a3863f9108755949f7` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.770246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=111d3b323d9e41a3863f9108755949f7)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:49.772285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:49.823620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111d3b323d9e41a3863f9108755949f7', 'request_id': 'req-1a13552f-4104-4b38-b517-e2bc07dcee6b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.831292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111d3b323d9e41a3863f9108755949f7', 'request_id': 'req-1a13552f-4104-4b38-b517-e2bc07dcee6b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.841771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111d3b323d9e41a3863f9108755949f7', 'request_id': 'req-1a13552f-4104-4b38-b517-e2bc07dcee6b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.856454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] The token cache is being invalidate because project 111d3b323d9e41a3863f9108755949f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:49.856750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.857490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1a13552f-4104-4b38-b517-e2bc07dcee6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:49.859259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1125/2261] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:49 2022] DELETE /identity/v3/projects/111d3b323d9e41a3863f9108755949f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:49.869913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.870278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.870654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.891382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:49.892628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:49.954442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1137/2262] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:49.962227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99eda2-5698-4540-8def-a549a380803f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:49.963098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99eda2-5698-4540-8def-a549a380803f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:49.963392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99eda2-5698-4540-8def-a549a380803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:49.982039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6f99eda2-5698-4540-8def-a549a380803f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:49.983277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6f99eda2-5698-4540-8def-a549a380803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:49.992282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1126/2263] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:49.996685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.011009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d66a-d0fe-41b7-bfa8-81074aefbcc2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.018011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.018710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.019411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.019411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.020083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:50.020385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.022005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.038084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1138/2264] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:11:50.042450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99eda2-5698-4540-8def-a549a380803f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.052791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99eda2-5698-4540-8def-a549a380803f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.057699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.058341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.058706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.058999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.059718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.061674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.092364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1127/2265] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:50.093735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.103804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc8ad-9155-4cc5-9a24-b7558193c2af admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.166114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.167008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.167302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.167611 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.168371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.170564 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.193293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1139/2266] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:50 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:50.198181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.211944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dac6b-9dcb-44c2-917a-f9112681e2f9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.213862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.214556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.214846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.215130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.215883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.217590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.230347 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1128/2267] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:50.234656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.245591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c89f-cdde-40ea-a87c-d574778553fc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.250302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.250968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.251253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.251541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.252324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.253917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e968df-21f5-4b9d-8c78-f9a17b254207 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.265137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1140/2268] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:50.269473 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.279510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719cb11-3429-4f75-b792-953652166d8f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.284958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.285974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.286484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.286776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] PATH_INFO: `/v3/projects/36f79b95d7764410abf43df74e239131/users/4a2ccbb7149a41cebdae4066c49e2f5e/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.307973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f79b95d7764410abf43df74e239131, user_id=4a2ccbb7149a41cebdae4066c49e2f5e, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.311557 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.321362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:50.329484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1129/2269] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:50 2022] PUT /identity/v3/projects/36f79b95d7764410abf43df74e239131/users/4a2ccbb7149a41cebdae4066c49e2f5e/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:50.342181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb62a-78ee-47e7-b2ca-fbc6d78135a4 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.342595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb62a-78ee-47e7-b2ca-fbc6d78135a4 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.342925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fb62a-78ee-47e7-b2ca-fbc6d78135a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.371733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-189fb62a-78ee-47e7-b2ca-fbc6d78135a4 None None] MFA Rules not processed for user `4a2ccbb7149a41cebdae4066c49e2f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:50.373062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-189fb62a-78ee-47e7-b2ca-fbc6d78135a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:50.404014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:50.465182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1141/2270] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:50.477058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:50.480758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:50.542196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39470195-8fcf-413d-8c4a-2e97151b5035 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:50.546109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:50.546766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:50.547056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:50.547340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:50.556997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:50.558430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:50.567430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1130/2271] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:51.914800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef89d-1335-44ae-b97f-4f4c4247dd5c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:51.915268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef89d-1335-44ae-b97f-4f4c4247dd5c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:51.915382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef89d-1335-44ae-b97f-4f4c4247dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:51.934336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-92eef89d-1335-44ae-b97f-4f4c4247dd5c None None] MFA Rules not processed for user `4a2ccbb7149a41cebdae4066c49e2f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:51.935526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-92eef89d-1335-44ae-b97f-4f4c4247dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:51.942312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1142/2272] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:57.307573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:57.309158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:57.374893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c667a-0a1e-4691-aeee-29c0b07a54ca service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:57.379403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:57.380312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:57.380590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:57.380863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] PATH_INFO: `/v3/users/d9ba21fee2934a13bfbe0315d335963d` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:57.382067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ba21fee2934a13bfbe0315d335963d)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:57.384032 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:57.431426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ba21fee2934a13bfbe0315d335963d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:57.432124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ba21fee2934a13bfbe0315d335963d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:57.439091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ba21fee2934a13bfbe0315d335963d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:57.446373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ba21fee2934a13bfbe0315d335963d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:57.446926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ba21fee2934a13bfbe0315d335963d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:57.465942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1131/2273] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:11:57 2022] DELETE /identity/v3/users/d9ba21fee2934a13bfbe0315d335963d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:57.470572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:57.471076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:57.471275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:57.489460 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:57.490665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:57.559238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1143/2274] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:11:57.568301 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:57.569792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:57.594331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:57.635770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286b435-5d46-4095-8a82-ec8f83c32117 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:57.640752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:57.641411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:57.641695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:57.641972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:57.652941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:57.654391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042c6f7-0264-4bd8-b479-0d879ad92997 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:57.666927 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1132/2275] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:11:57.954336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:57.956631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:57.972807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634265-7479-4957-97cc-7fe7b44183eb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:57.979219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:57.980256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:57.980555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:57.980837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] PATH_INFO: `/v3/projects/03c835e7ffb64007b10825c0a74cc8ed` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:57.982938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c835e7ffb64007b10825c0a74cc8ed)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:57.984989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.039002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c835e7ffb64007b10825c0a74cc8ed', 'request_id': 'req-da0bf3e3-df04-4726-901c-e67bf74148d1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:58.048969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c835e7ffb64007b10825c0a74cc8ed', 'request_id': 'req-da0bf3e3-df04-4726-901c-e67bf74148d1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:58.056789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c835e7ffb64007b10825c0a74cc8ed', 'request_id': 'req-da0bf3e3-df04-4726-901c-e67bf74148d1'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:58.070854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] The token cache is being invalidate because project 03c835e7ffb64007b10825c0a74cc8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:11:58.070854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:58.071986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-da0bf3e3-df04-4726-901c-e67bf74148d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:11:58.076014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1144/2276] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:11:57 2022] DELETE /identity/v3/projects/03c835e7ffb64007b10825c0a74cc8ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:11:58.079967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.080287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.080551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.109738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:58.111049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:58.170585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1133/2277] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:58.178615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.178911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.179194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.198313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:58.200087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:58.208528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1145/2278] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:58.212858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.224112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951102-b9f0-4203-8c5b-d32e3d61a1ad None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.229038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.229823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.230121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.230425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.231192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:11:58.231511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.233430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.246333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1134/2279] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:11:58.250731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.261135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf60d2-7101-477e-b53e-39768a990324 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.266669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.267318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.267609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.267889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.268773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.271176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.307269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1146/2280] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:11:58 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:11:58.309158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.322265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e59aff-c111-4d79-9f7a-5880634662d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.388534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.389266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.389555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.389899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.390623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.392765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.419996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1135/2281] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:11:58 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:11:58.422546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.434432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0f84-3d34-48b5-a5df-7ff6d5490728 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.439554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.440386 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.440562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.440842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.441581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.443208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.454997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1147/2282] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:11:58.459072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.469245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f330ca-fb5f-4b86-8815-e3cf6c65ee81 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.474377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.475034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.475319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.475599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.476377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.477970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf3e24-cf09-444f-bad8-79542ef6efe8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.488923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1136/2283] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:11:58.493055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.500012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:58.503885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7717f-5dd4-48e3-a503-3d3fbc01984c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.509702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.510769 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.511114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.512400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] PATH_INFO: `/v3/projects/a3b8d108ee204c20820d4002adf57578/users/ba2aaa054c3c4e71b76862271bfd040a/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.527646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b8d108ee204c20820d4002adf57578, user_id=ba2aaa054c3c4e71b76862271bfd040a, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.530424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.542947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1148/2284] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:11:58 2022] PUT /identity/v3/projects/a3b8d108ee204c20820d4002adf57578/users/ba2aaa054c3c4e71b76862271bfd040a/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:11:58.553385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6540a1-dbcc-405a-b69c-194a703ff09b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.553685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6540a1-dbcc-405a-b69c-194a703ff09b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.553971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6540a1-dbcc-405a-b69c-194a703ff09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.581871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ca6540a1-dbcc-405a-b69c-194a703ff09b None None] MFA Rules not processed for user `ba2aaa054c3c4e71b76862271bfd040a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:11:58.583102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ca6540a1-dbcc-405a-b69c-194a703ff09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:58.603796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:11:58.649542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1137/2285] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:11:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:11:58.660718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:11:58.662418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:11:58.721547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0212-400b-463a-85a5-7a1e78e0ff0a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:11:58.725253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:11:58.725909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:11:58.726198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:11:58.726479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:11:58.735890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:11:58.737375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b22f2-ab15-433e-b64a-676c2aa4512e service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:11:58.746870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1149/2286] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:11:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:01.622743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2439-4288-4417-84f4-4768132231ea None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:01.623187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2439-4288-4417-84f4-4768132231ea None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:01.623291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2439-4288-4417-84f4-4768132231ea None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:01.624850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1138/2287] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:12:01.638289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:01.638732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:01.638851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:01.658205 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] MFA Rules not processed for user `503e24d396e2421bb0df4392288ac658`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:01.661551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:01.739446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1150/2288] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:12:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:01.942298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2439-4288-4417-84f4-4768132231ea None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:01.944960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d37c2439-4288-4417-84f4-4768132231ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:01.967397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2439-4288-4417-84f4-4768132231ea None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:01.981230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:01.981996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:01.982349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:01.983510 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:01.994331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:01.996695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:02.017486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:02.019252 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:02.032024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1139/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:02.109722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb1ce0-9b37-4050-9401-3a404ca2dac3 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:02.114355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:02.115224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:02.115505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:02.115776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] PATH_INFO: `/v3/users/3fb3a18d5f0d46db8538f77776005540` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:02.116980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb3a18d5f0d46db8538f77776005540)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:02.119372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:02.141711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:02.176086 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb3a18d5f0d46db8538f77776005540'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.183906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb3a18d5f0d46db8538f77776005540'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.184630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb3a18d5f0d46db8538f77776005540'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.193294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb3a18d5f0d46db8538f77776005540'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.193973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb3a18d5f0d46db8538f77776005540'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.213640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1151/2290] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:01 2022] DELETE /identity/v3/users/3fb3a18d5f0d46db8538f77776005540 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:02.538124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:02.548855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353a975-c171-49b1-b955-e9f5a39b9443 service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:02.612388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:02.613256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:02.613544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:02.613827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] PATH_INFO: `/v3/projects/2f4ebdd243744d379ebf18906f75f623` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:02.615013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4ebdd243744d379ebf18906f75f623)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:02.616955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:02.664613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4ebdd243744d379ebf18906f75f623', 'request_id': 'req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.670275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4ebdd243744d379ebf18906f75f623', 'request_id': 'req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.677730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4ebdd243744d379ebf18906f75f623', 'request_id': 'req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.689426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] The token cache is being invalidate because project 2f4ebdd243744d379ebf18906f75f623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:02.689717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.690355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.691948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1140/2291] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:02 2022] DELETE /identity/v3/projects/2f4ebdd243744d379ebf18906f75f623 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:02.695980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:02.697397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:02.711526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d0f2-a5c6-4dd0-9557-5b00264f5061 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:02.780606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:02.781487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:02.781779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:02.782071 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] PATH_INFO: `/v3/users/142d5cc9f2f94d19b78b86163f8bc407` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:02.783433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142d5cc9f2f94d19b78b86163f8bc407)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:02.785568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:02.846562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142d5cc9f2f94d19b78b86163f8bc407'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.853428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142d5cc9f2f94d19b78b86163f8bc407'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.854087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142d5cc9f2f94d19b78b86163f8bc407'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.861075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142d5cc9f2f94d19b78b86163f8bc407'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.861806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-68179f9e-9300-486d-8012-913fc7a1de63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142d5cc9f2f94d19b78b86163f8bc407'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:02.879660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1152/2292] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:02 2022] DELETE /identity/v3/users/142d5cc9f2f94d19b78b86163f8bc407 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:03.052342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.053901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:03.070197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b7455-0c38-41ee-a9b8-d0e436f1fbdd admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.134738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:03.169574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.170448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.170733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.171037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] PATH_INFO: `/v3/projects/84fcb343c6684fdbbcea81c97c9591fe` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.172625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fcb343c6684fdbbcea81c97c9591fe)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.175507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.235973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fcb343c6684fdbbcea81c97c9591fe', 'request_id': 'req-f8b99828-18cf-416c-879d-cade9f8d72b3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:03.242682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fcb343c6684fdbbcea81c97c9591fe', 'request_id': 'req-f8b99828-18cf-416c-879d-cade9f8d72b3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:03.254992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fcb343c6684fdbbcea81c97c9591fe', 'request_id': 'req-f8b99828-18cf-416c-879d-cade9f8d72b3'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:03.268345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] The token cache is being invalidate because project 84fcb343c6684fdbbcea81c97c9591fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:03.268643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:03.273360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f8b99828-18cf-416c-879d-cade9f8d72b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:03.277391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1141/2293] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:03 2022] DELETE /identity/v3/projects/84fcb343c6684fdbbcea81c97c9591fe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:03.282569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.282869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.283156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.310802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:03.312226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:03.329527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:03.389581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1153/2294] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:03.397277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.397578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.397866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.416785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:03.418538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:03.426577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1142/2295] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:03.430840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.440971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d9fc5-2d0e-4da6-8340-3f38dbedd53f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.446012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.446675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.446960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.447237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.448271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:12:03.448583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.450245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.465313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1154/2296] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:12:03.466444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.476008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db3eba-a49c-47a0-80ee-65840e21c40b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.481215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.481877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.482164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.482833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.483553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.486190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.514742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1143/2297] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:12:03 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:03.516186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.526310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c1a15-e755-4d81-a25b-6349552b996e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.584714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.585395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.585685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.585964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.586676 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.588633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.611839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1155/2298] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:12:03 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:03.615789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.626374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc7e7a-052a-403b-a548-96303e48071d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.631574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.632308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.632599 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.632881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.633734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.635412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.646957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1144/2299] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:03.651277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.662268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af84057-7edf-40ca-9f6d-23eeb4a3252a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.667310 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.668612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.668880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.669160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.669900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.671503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235e21-399e-4798-9b30-ce1dcd98a386 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.682195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1156/2300] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:03.686476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.696788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769d6f-d70c-40e5-ae1b-24dc973b4e4d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.702074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.702952 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.703246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.703546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] PATH_INFO: `/v3/projects/a22539a647d74bf3b99ac2662a51c053/users/7fa2e90d4d2b414395fef3a98cf3e8f4/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.719536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22539a647d74bf3b99ac2662a51c053, user_id=7fa2e90d4d2b414395fef3a98cf3e8f4, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.723397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.747549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1145/2301] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:03 2022] PUT /identity/v3/projects/a22539a647d74bf3b99ac2662a51c053/users/7fa2e90d4d2b414395fef3a98cf3e8f4/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:12:03.758229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.758747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.758844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.794160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] MFA Rules not processed for user `7fa2e90d4d2b414395fef3a98cf3e8f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:03.796146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:03.868116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1157/2302] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:03.877778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:03.879535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:03.941780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3da7b-9207-48af-a9e6-489a409370cf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:03.945501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:03.946154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:03.946441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:03.946728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:03.956062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:03.957497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105830f-960b-4a35-82ad-f9b4f07dd9d6 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:03.967172 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1146/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:06.497175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:06.514523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:06.566761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89efb7-49eb-4f68-89d4-47a8a4c4feaa None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:06.571286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:06.572202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:06.572494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:06.573040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] PATH_INFO: `/v3/users/7fa2e90d4d2b414395fef3a98cf3e8f4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:06.574249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa2e90d4d2b414395fef3a98cf3e8f4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:06.576219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:06.625929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa2e90d4d2b414395fef3a98cf3e8f4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:06.637147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa2e90d4d2b414395fef3a98cf3e8f4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:06.638076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa2e90d4d2b414395fef3a98cf3e8f4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:06.646380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa2e90d4d2b414395fef3a98cf3e8f4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:06.647277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa2e90d4d2b414395fef3a98cf3e8f4'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:06.667417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1158/2304] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:06 2022] DELETE /identity/v3/users/7fa2e90d4d2b414395fef3a98cf3e8f4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:06.672505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:06.673208 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:06.673690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:06.680903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:06.703549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:06.704871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:06.766250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1147/2305] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:06.776180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:06.777589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:06.834879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d66b94-9d2f-437d-8113-0a8063459ec5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:06.838512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:06.839164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:06.839421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:06.839696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:06.849605 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:06.851018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cd9e7-a6ea-4800-951f-5186dc62d455 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:06.861091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1159/2306] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:07.142403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.143924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:07.156584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9dd6-999b-4208-ab26-64b12eb1822e None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.161112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.161963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.162244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.162517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] PATH_INFO: `/v3/projects/a22539a647d74bf3b99ac2662a51c053` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.163760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22539a647d74bf3b99ac2662a51c053)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.165687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.222160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22539a647d74bf3b99ac2662a51c053', 'request_id': 'req-1041459b-2994-4b11-977c-c373c6eab5d2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:07.227549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22539a647d74bf3b99ac2662a51c053', 'request_id': 'req-1041459b-2994-4b11-977c-c373c6eab5d2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:07.235141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22539a647d74bf3b99ac2662a51c053', 'request_id': 'req-1041459b-2994-4b11-977c-c373c6eab5d2'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:07.246214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] The token cache is being invalidate because project a22539a647d74bf3b99ac2662a51c053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:07.246521 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:07.247134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1041459b-2994-4b11-977c-c373c6eab5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:07.248715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1148/2307] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:07 2022] DELETE /identity/v3/projects/a22539a647d74bf3b99ac2662a51c053 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:07.253650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.253960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.254242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.272082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:07.273282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:07.308000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:07.353024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1160/2308] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:07.357617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.357917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.358201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.379939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:07.381212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:07.390533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1149/2309] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:07.394919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.406157 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f7eb8-5fa5-4124-b03c-7b04b023fd05 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.413269 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.414006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.414437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.414726 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.415509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:12:07.415825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.417552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.436447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1161/2310] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:12:07.438958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.449099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9c112-e092-4ba8-b66e-f4a438ac9a94 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.454680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.455553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.455676 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.455967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.456780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.458785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.487264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1150/2311] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:12:07 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:12:07.491715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.502490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34531ba2-4641-417c-b022-81dc7e441811 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.591094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.591733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.592130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.592453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.593165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.595187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.617912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1162/2312] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:12:07 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:07.622636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.632756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3cbb-924f-4042-8e8a-87db353521bc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.637945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.638597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.638890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.639242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.640108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.641851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.652640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1151/2313] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:07.661690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.672318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf5f1f-ba66-4e12-b007-59b854802467 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.678237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.679010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.679365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.679710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.680600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.682382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482d145-49e0-4638-a07c-bd86cfe14548 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.694552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1163/2314] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:07.699610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.709742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ade2-f023-435d-bb59-38cea0e8cbf7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.714605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.715602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.715945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.716523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] PATH_INFO: `/v3/projects/40c05667a6bf4c9388d8ac779fa1ba81/users/bff510026042435e9ca0596c9727198a/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.732486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c05667a6bf4c9388d8ac779fa1ba81, user_id=bff510026042435e9ca0596c9727198a, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.735207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.749038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1152/2315] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:07 2022] PUT /identity/v3/projects/40c05667a6bf4c9388d8ac779fa1ba81/users/bff510026042435e9ca0596c9727198a/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:07.754252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f165-47e9-4f03-8a0e-6fd25a6a3709 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.754549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f165-47e9-4f03-8a0e-6fd25a6a3709 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.754829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f165-47e9-4f03-8a0e-6fd25a6a3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.772563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9ec5f165-47e9-4f03-8a0e-6fd25a6a3709 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:07.773765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9ec5f165-47e9-4f03-8a0e-6fd25a6a3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:07.831401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1164/2316] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:07.840820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:07.842485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:07.869749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:07.900913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fd74-1e71-40e4-ad1c-555555b28caf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:07.904800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:07.905435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:07.905718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:07.905994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:07.915996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:07.917432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:07.927534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1153/2317] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:08.574958 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa08-3f5b-40eb-b890-dd899881a08d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:08.576023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa08-3f5b-40eb-b890-dd899881a08d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:08.576115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedaa08-3f5b-40eb-b890-dd899881a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:08.631615 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6dedaa08-3f5b-40eb-b890-dd899881a08d None None] MFA Rules not processed for user `bff510026042435e9ca0596c9727198a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:08.633265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6dedaa08-3f5b-40eb-b890-dd899881a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:08.676640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:08.748459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1165/2318] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:08.773857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:08.775396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:08.864478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936c51b-9a2f-426e-9066-a01ca953c61e service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:08.868176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:08.869038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:08.869321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:08.869595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:08.883635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:08.885409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de809-6e4f-4687-b95f-e82d0502b999 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:08.899005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1154/2319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:10.305873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:10.306401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:10.306570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:10.326220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] MFA Rules not processed for user `bff510026042435e9ca0596c9727198a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:10.327530 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:10.334731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1166/2320] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:10.777646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ca7b-629d-4c10-a4bf-59d2f33ef4af None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:10.778134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ca7b-629d-4c10-a4bf-59d2f33ef4af None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:10.778275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ca7b-629d-4c10-a4bf-59d2f33ef4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:10.797748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1f71ca7b-629d-4c10-a4bf-59d2f33ef4af None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:10.799136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1f71ca7b-629d-4c10-a4bf-59d2f33ef4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:10.857717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1155/2321] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:10.909629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:10.911066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:10.992170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126fd1c-a63b-49ee-8d59-dcc27789eaf8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:10.998473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:10.999188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:10.999479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:10.999760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:11.010381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:11.012028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:11.021354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1167/2322] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:12:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:12:11.646182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc66c-a402-4466-8ac4-c0324d6edf79 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:11.646479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc66c-a402-4466-8ac4-c0324d6edf79 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:11.646769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bc66c-a402-4466-8ac4-c0324d6edf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:11.664549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-212bc66c-a402-4466-8ac4-c0324d6edf79 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:11.665759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-212bc66c-a402-4466-8ac4-c0324d6edf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:11.673512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1156/2323] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:11.686834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:11.696995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a139a2-d3ec-4d84-9dc7-8db023facf34 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:11.702817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:11.703459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:11.703741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:11.704053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:11.712722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:11.714335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:11.724384 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1168/2324] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:12:11.943450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cbc9-8cd5-4efa-a086-469a8239d2b7 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:11.943921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cbc9-8cd5-4efa-a086-469a8239d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:11.944151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3cbc9-8cd5-4efa-a086-469a8239d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:11.963137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-67a3cbc9-8cd5-4efa-a086-469a8239d2b7 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:11.964482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-67a3cbc9-8cd5-4efa-a086-469a8239d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:11.972797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1157/2325] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:11.987729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:12.000710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b94c5-66be-4db0-b5ab-3ea8eac1fcf1 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:12.006933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:12.007588 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:12.007899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:12.008229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:12.017237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:12.018986 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:12.030395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1169/2326] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:12:12.460861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:12.461155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:12.461463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:12.478822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:12.480074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:12.488004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1158/2327] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:12.502771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:12.514526 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f1cf8-5543-40d5-b447-824919fd30c1 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:12.520024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:12.520758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:12.521047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:12.521329 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:12.530212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:12.531781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfd5c5-c4c6-436e-8d2e-af3b9b6e2069 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:12.541284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1170/2328] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:12:14.853366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:14.857852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:14.873918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041348fd-6b3f-4e76-aa04-73d29486149f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:14.880762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:14.881645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:14.881936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:14.882220 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] PATH_INFO: `/v3/users/4a2ccbb7149a41cebdae4066c49e2f5e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:14.883682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2ccbb7149a41cebdae4066c49e2f5e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:14.888695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:14.954990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2ccbb7149a41cebdae4066c49e2f5e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:14.956359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2ccbb7149a41cebdae4066c49e2f5e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:14.964008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:14.968254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2ccbb7149a41cebdae4066c49e2f5e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:14.977407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2ccbb7149a41cebdae4066c49e2f5e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:14.978085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2ccbb7149a41cebdae4066c49e2f5e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.004383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1159/2329] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:14 2022] DELETE /identity/v3/users/4a2ccbb7149a41cebdae4066c49e2f5e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:15.008727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:15.009831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:15.010325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:15.036250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:15.037852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:15.138715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1171/2330] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:15.148775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:15.150263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:15.211357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc99d-c78a-49a3-a103-70828a3dadaf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:15.215160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:15.215837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:15.216278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:15.216563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:15.225460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:15.226950 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:15.237054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1160/2331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:15.411870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:15.413519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:15.427256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd12dd-5aff-49fc-9aba-003e1fa9153f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:15.435541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:15.436714 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:15.437367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:15.437878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] PATH_INFO: `/v3/projects/36f79b95d7764410abf43df74e239131` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:15.440084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f79b95d7764410abf43df74e239131)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:15.442239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:15.456884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:15.495534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f79b95d7764410abf43df74e239131', 'request_id': 'req-fb652b5c-83cc-44b3-84e7-a05c602f02c5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.503629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f79b95d7764410abf43df74e239131', 'request_id': 'req-fb652b5c-83cc-44b3-84e7-a05c602f02c5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.509148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f79b95d7764410abf43df74e239131', 'request_id': 'req-fb652b5c-83cc-44b3-84e7-a05c602f02c5'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.520921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] The token cache is being invalidate because project 36f79b95d7764410abf43df74e239131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:15.521211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.521853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fb652b5c-83cc-44b3-84e7-a05c602f02c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:15.523414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1172/2332] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:15 2022] DELETE /identity/v3/projects/36f79b95d7764410abf43df74e239131 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:17.296828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:17.298231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:17.311649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452bda-eddc-4e6e-85ef-5bb0b3a39721 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:17.368583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:17.369459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:17.369746 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:17.370028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] PATH_INFO: `/v3/users/466b35770270477e974c61739f65c31f` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:17.371222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=466b35770270477e974c61739f65c31f)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:17.373804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:17.421617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466b35770270477e974c61739f65c31f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:17.422273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466b35770270477e974c61739f65c31f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:17.429312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466b35770270477e974c61739f65c31f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:17.436969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466b35770270477e974c61739f65c31f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:17.437606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466b35770270477e974c61739f65c31f'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:17.444765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:17.457453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1161/2333] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:17 2022] DELETE /identity/v3/users/466b35770270477e974c61739f65c31f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:17.461959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:17.462439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:17.462543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:17.480581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:17.481933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:17.554794 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1173/2334] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:17.565177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:17.566634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:17.625769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525a7ec-5306-4e53-802a-45ea3212af1e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:17.629426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:17.630085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:17.630369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:17.630649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:17.639636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:17.641163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46041f-4453-4283-9c57-27dd2462388e service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:17.650678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1162/2335] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:17.942296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:17.944113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:17.957975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72727aea-f304-4d4c-adbc-20fc1ccbf292 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:17.963097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:17.964181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:17.964471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:17.964754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] PATH_INFO: `/v3/projects/bf33d8b18afc4fbe8b05a9b0d5f6f703` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:17.966596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf33d8b18afc4fbe8b05a9b0d5f6f703)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:17.969291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.036323 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf33d8b18afc4fbe8b05a9b0d5f6f703', 'request_id': 'req-b1e3ceff-8f15-4bce-9cf4-958a933519a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:18.047075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf33d8b18afc4fbe8b05a9b0d5f6f703', 'request_id': 'req-b1e3ceff-8f15-4bce-9cf4-958a933519a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:18.057010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf33d8b18afc4fbe8b05a9b0d5f6f703', 'request_id': 'req-b1e3ceff-8f15-4bce-9cf4-958a933519a2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:18.069040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] The token cache is being invalidate because project bf33d8b18afc4fbe8b05a9b0d5f6f703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:18.069435 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:18.070121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b1e3ceff-8f15-4bce-9cf4-958a933519a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:18.071675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1174/2336] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:17 2022] DELETE /identity/v3/projects/bf33d8b18afc4fbe8b05a9b0d5f6f703 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:18.077354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.078277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.078277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.099079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:18.100351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:18.163753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1163/2337] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:18.171865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.172194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.172481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.191599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:18.193160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:18.207921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1175/2338] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:18.209504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.220368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd7803-3f8a-44a9-bc5e-332c66ab138f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.225004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.225693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.226008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.226395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.227205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:12:18.227522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.229607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.243992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1164/2339] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:12:18.246264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.256636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0df86-bd7f-4a7c-95c3-758bd0abc394 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.261311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.261975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.262259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.262534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.263238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.265700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.280002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:18.300238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1176/2340] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:12:18 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:18.304366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.315360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ef4c3-f964-4c27-b5ca-fa9a5426dedd admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.374720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.375399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.375682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.375970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.376689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.378604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.401858 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1165/2341] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:12:18 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:18.403702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.415944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92f91-cf35-44cd-b8d1-963806b03acb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.420721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.421379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.421666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.421941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.422666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.424409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.434810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1177/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:18.438882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.449757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e689-5270-4558-aaf9-6f4d7c9c3a8b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.455175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.455846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.456170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.456454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.457196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.458828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc75bd-07c8-466d-a3f0-a72fa029246f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.461063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:18.474306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1166/2343] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:18.475777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.486863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91b7ad-6e0f-475e-82ee-b60101ad0e19 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.491374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.492286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.492566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.492840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] PATH_INFO: `/v3/projects/05c1ab53ada0498baf5e75f54fe6cc9e/users/7a16039e881f4f9190e20ddbc1c776a6/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.509271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c1ab53ada0498baf5e75f54fe6cc9e, user_id=7a16039e881f4f9190e20ddbc1c776a6, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.511918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.526041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1178/2344] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:18 2022] PUT /identity/v3/projects/05c1ab53ada0498baf5e75f54fe6cc9e/users/7a16039e881f4f9190e20ddbc1c776a6/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:18.536655 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.536951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.537238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.563436 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] MFA Rules not processed for user `7a16039e881f4f9190e20ddbc1c776a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:18.564753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:18.640650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1167/2345] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:18.652259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:18.654046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:18.714327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab3b1-9c3b-4fc7-8469-ab14ba042339 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:18.718005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:18.718654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:18.718939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:18.719216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:18.727765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:18.729237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444be46-9c3a-4466-8bde-e4a082e54410 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:18.738260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1179/2346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:23.803448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:23.875798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f15c-ac82-4274-8cea-90af6de45870 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:23.880383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:23.881250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:23.881563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:23.881837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] PATH_INFO: `/v3/users/7a16039e881f4f9190e20ddbc1c776a6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:23.883041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a16039e881f4f9190e20ddbc1c776a6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:23.885004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:23.937810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a16039e881f4f9190e20ddbc1c776a6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:23.938468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a16039e881f4f9190e20ddbc1c776a6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:23.945326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a16039e881f4f9190e20ddbc1c776a6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:23.953760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a16039e881f4f9190e20ddbc1c776a6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:23.954439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a16039e881f4f9190e20ddbc1c776a6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:23.973538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1168/2347] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:23 2022] DELETE /identity/v3/users/7a16039e881f4f9190e20ddbc1c776a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:23.978110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:23.978642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:23.978739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:23.995797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:23.997059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:24.060273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1180/2348] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:24.070878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:24.072351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:24.083246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:24.132689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4495f-cefc-425b-abd4-e6542fad5f3d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:24.136241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:24.136883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:24.137168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:24.137449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:24.149571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:24.151008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfbcd2-d994-487b-8b69-7e19b7a0e358 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:24.162008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1169/2349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:24.451367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:24.453400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:24.476325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab119c3-db58-40dd-97c8-100b9346988f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:24.483649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:24.485002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:24.485453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:24.485740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] PATH_INFO: `/v3/projects/05c1ab53ada0498baf5e75f54fe6cc9e` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:24.487129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c1ab53ada0498baf5e75f54fe6cc9e)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:24.489105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:24.539061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c1ab53ada0498baf5e75f54fe6cc9e', 'request_id': 'req-fa406ccd-45c3-458d-9940-96494cc1b6a9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:24.546888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c1ab53ada0498baf5e75f54fe6cc9e', 'request_id': 'req-fa406ccd-45c3-458d-9940-96494cc1b6a9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:24.548381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:24.554101 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c1ab53ada0498baf5e75f54fe6cc9e', 'request_id': 'req-fa406ccd-45c3-458d-9940-96494cc1b6a9'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:24.567999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] The token cache is being invalidate because project 05c1ab53ada0498baf5e75f54fe6cc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:24.568322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:24.568980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:24.570558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1181/2350] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:24 2022] DELETE /identity/v3/projects/05c1ab53ada0498baf5e75f54fe6cc9e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:34.156923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=23 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:34.160053 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a060-7404-4745-9347-289dd83a4d21 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:34.160562 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a060-7404-4745-9347-289dd83a4d21 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:34.161012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a060-7404-4745-9347-289dd83a4d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:34.188385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2954a060-7404-4745-9347-289dd83a4d21 None None] MFA Rules not processed for user `77ef8043cfee4a97bc6990264dbd7b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:34.189595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2954a060-7404-4745-9347-289dd83a4d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:34.262527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1170/2351] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:34.564601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:41.514536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:41.516059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:41.631743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa406ccd-45c3-458d-9940-96494cc1b6a9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:41.636444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:41.637318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:41.637604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:41.637881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] PATH_INFO: `/v3/users/ba2aaa054c3c4e71b76862271bfd040a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:41.639134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2aaa054c3c4e71b76862271bfd040a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:41.641035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:41.686131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2aaa054c3c4e71b76862271bfd040a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:41.692853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2aaa054c3c4e71b76862271bfd040a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:41.693508 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2aaa054c3c4e71b76862271bfd040a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:41.700891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2aaa054c3c4e71b76862271bfd040a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:41.701525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2aaa054c3c4e71b76862271bfd040a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:41.718671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1182/2352] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:12:41 2022] DELETE /identity/v3/users/ba2aaa054c3c4e71b76862271bfd040a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:41.723720 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:41.724213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:41.724332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:41.750631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:41.751835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:41.810175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1171/2353] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:41.819647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:41.821082 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:41.855332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:41.921252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe204-137d-4f8a-aef5-86ac7ce2f022 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:41.925697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:41.926347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:41.926632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:41.926934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:41.936240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:41.937674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1affa9d-c158-49b3-88d2-9f84319f7cba service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:41.947332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1183/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:42.371788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.373230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:42.386190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9eee6-0572-451d-92f4-c4e69f862847 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.390849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.391837 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.392144 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.392417 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] PATH_INFO: `/v3/projects/a3b8d108ee204c20820d4002adf57578` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.394249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b8d108ee204c20820d4002adf57578)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.396217 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.457975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b8d108ee204c20820d4002adf57578', 'request_id': 'req-9e5bc383-64e0-466f-8e14-b25ddaaa0494'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:42.466833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b8d108ee204c20820d4002adf57578', 'request_id': 'req-9e5bc383-64e0-466f-8e14-b25ddaaa0494'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:42.479470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b8d108ee204c20820d4002adf57578', 'request_id': 'req-9e5bc383-64e0-466f-8e14-b25ddaaa0494'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:42.482126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:42.496150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] The token cache is being invalidate because project a3b8d108ee204c20820d4002adf57578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:12:42.496445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:42.497170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-9e5bc383-64e0-466f-8e14-b25ddaaa0494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:12:42.499631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1172/2355] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:12:42 2022] DELETE /identity/v3/projects/a3b8d108ee204c20820d4002adf57578 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:42.506511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.506886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.507004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.550008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:42.551471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:42.618349 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1184/2356] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:42.626663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.628195 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.628531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.651582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:42.652928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:42.662331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1173/2357] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:42.667766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.683334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68da0d8-306e-433d-9b02-dd1cd3177423 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.691440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.692152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.692477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.692717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.693487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:12:42.694387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.695573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.709337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1185/2358] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:12:42.713752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.725359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42586d-d25e-495e-8ff2-aa2911f17b48 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.730242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.731064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.731414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.731768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.732685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.734703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.761282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1174/2359] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:12:42 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:42.765418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.775264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52456f1-4187-4d3e-9775-f39687d68475 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.830346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.831032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.831322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.831600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.832413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.834327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.843683 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:42.854655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1186/2360] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:12:42 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:42.858910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.869688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f384d-7353-4342-af98-ae28813486c5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.874279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.874932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.875225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.875508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.876278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.878515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.888777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1175/2361] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:42.892669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.902622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499ac3a-d738-457a-80e0-e9b5d55acaff admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.907394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.908080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.908378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.908677 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.909396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.910994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04af9e5-2106-431b-954e-82eac9174dcb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.920874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1187/2362] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:42.925304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:42.935205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762368f-6433-4311-ab00-be8bb95433e3 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:42.940536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:42.941589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.941963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.942245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] PATH_INFO: `/v3/projects/9f083759f0d1493abe1b4e3287c18188/users/8163e01b50d34b588932d259b84a1adb/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.957190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f083759f0d1493abe1b4e3287c18188, user_id=8163e01b50d34b588932d259b84a1adb, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:42.959815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:42.972437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1176/2363] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:42 2022] PUT /identity/v3/projects/9f083759f0d1493abe1b4e3287c18188/users/8163e01b50d34b588932d259b84a1adb/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:42.977405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089db3-339b-48fd-a1c3-7a8e6f121b3b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:42.977695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089db3-339b-48fd-a1c3-7a8e6f121b3b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:42.977974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18089db3-339b-48fd-a1c3-7a8e6f121b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:42.996168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-18089db3-339b-48fd-a1c3-7a8e6f121b3b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:42.997370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-18089db3-339b-48fd-a1c3-7a8e6f121b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:43.056927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1188/2364] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:43.067240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:43.068998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:43.137212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab021ff-ee5e-4a5a-8f79-a799ae0c9bfb admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:43.140965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:43.141615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:43.141911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:43.142197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:43.151494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:43.152970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:43.163413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1177/2365] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:12:47.561740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:47.562331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:47.562532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:47.601209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] MFA Rules not processed for user `8163e01b50d34b588932d259b84a1adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:47.602538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:47.673850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1189/2366] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:12:47.678900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:47.689070 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25267b-0272-4db4-b48c-edfd1018280a service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:47.693820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:47.694485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:47.694769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:47.695047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:47.695761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:47.697753 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:47.726097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1178/2367] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:12:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:47.730206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:47.741883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63879d6-b8ae-4597-a6fc-51a0551c454c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:47.811083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:47.811771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:47.812110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:47.812385 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:47.813083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:47.815254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:47.837286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1190/2368] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:12:47 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:12:47.841340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:47.860409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a46-841b-4bd5-993b-a64e1c5347a4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:47.870391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:47.871099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:47.872681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:47.872681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:47.872681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:47.874047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:47.890444 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1179/2369] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:47.894544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:47.901665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:47.905897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fbe27-89fc-47a3-a1b6-bdc3ed9632fa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:47.920591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:47.921820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:47.923810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:47.927774 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] PATH_INFO: `/v3/projects/afd71cdedd1d4126b2cf32113b95180b/users/1862692c820a4874952de18d0af9cc04/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:47.946056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd71cdedd1d4126b2cf32113b95180b, user_id=1862692c820a4874952de18d0af9cc04, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:47.949076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:47.967287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1191/2370] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:47 2022] PUT /identity/v3/projects/afd71cdedd1d4126b2cf32113b95180b/users/1862692c820a4874952de18d0af9cc04/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:47.968960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:47.980486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4bac7-586d-44dc-86ea-179463ccf3a9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:48.067470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:48.068177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:48.068468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:48.068752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:48.069508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:48.071811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cf1d-cca1-4dcd-b14e-3a14e71d52d0 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:48.074931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:48.092170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1180/2371] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:12:48.093933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:48.105382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0397b31-8a6a-4112-838f-bbafaee566c9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:48.110240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:48.111177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:48.111451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:48.111835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] PATH_INFO: `/v3/projects/afd71cdedd1d4126b2cf32113b95180b/users/1862692c820a4874952de18d0af9cc04/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:48.113849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd71cdedd1d4126b2cf32113b95180b, user_id=1862692c820a4874952de18d0af9cc04, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:48.116568 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:48.135008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1192/2372] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:12:48 2022] PUT /identity/v3/projects/afd71cdedd1d4126b2cf32113b95180b/users/1862692c820a4874952de18d0af9cc04/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:12:53.481975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc91-10fb-45b0-834c-da5c87829ce9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:53.482942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc91-10fb-45b0-834c-da5c87829ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:53.483407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc91-10fb-45b0-834c-da5c87829ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:53.513303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3925bc91-10fb-45b0-834c-da5c87829ce9 None None] MFA Rules not processed for user `1862692c820a4874952de18d0af9cc04`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:53.514902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3925bc91-10fb-45b0-834c-da5c87829ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:53.603721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1181/2373] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:12:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:53.615663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:53.617426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:53.680995 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55144d6-cb65-4a98-9cc8-8abff85879fe admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:53.684978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:53.685336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:53.685621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:53.685900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:53.757407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:53.758909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:53.769799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1193/2374] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:53.895482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917331-dec1-4f9c-b27d-c0c09db6ad88 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:53.895866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917331-dec1-4f9c-b27d-c0c09db6ad88 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:53.896270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8917331-dec1-4f9c-b27d-c0c09db6ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:53.931895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f8917331-dec1-4f9c-b27d-c0c09db6ad88 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:53.933013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f8917331-dec1-4f9c-b27d-c0c09db6ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:54.027002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1182/2375] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:12:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:54.042553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:54.044741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:54.124019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70189b9-097a-4832-b7aa-70b63dff54c6 service glance] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:54.132691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:54.133750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:54.134303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:54.134746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:54.146680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:54.148490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:54.158401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1194/2376] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:12:54.348991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf45c-56d5-45ac-ae42-ddee0a06f74b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:54.348991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf45c-56d5-45ac-ae42-ddee0a06f74b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:54.348991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf45c-56d5-45ac-ae42-ddee0a06f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:54.403022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6bcbf45c-56d5-45ac-ae42-ddee0a06f74b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:54.404777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6bcbf45c-56d5-45ac-ae42-ddee0a06f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:54.497039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1183/2377] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:54.520315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:54.522029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:54.547806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:54.681394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea5d52-cbaf-407d-9c33-a4fd73faf334 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:54.690212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:54.690891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:54.691183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:54.691463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:54.705122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:54.706768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:54.717966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1195/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:12:58.643867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10217de-f94b-480e-ad9a-34f2a03f6ee4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:58.644966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10217de-f94b-480e-ad9a-34f2a03f6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:58.645284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10217de-f94b-480e-ad9a-34f2a03f6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:58.655851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=100 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:12:58.681260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-d10217de-f94b-480e-ad9a-34f2a03f6ee4 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:12:58.682470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d10217de-f94b-480e-ad9a-34f2a03f6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:58.691041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1184/2379] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:12:58.732586 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:12:58.739791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:12:58.760359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49109572-9398-4d8b-b111-f24581e9518d service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:12:58.766792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:12:58.768324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:12:58.768857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:12:58.769500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:12:58.786129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:12:58.787878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188d8b-4d85-460f-8ccc-e2f923928484 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:12:58.799302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1196/2380] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:03.560710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:03.561245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:03.561369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:03.578946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] MFA Rules not processed for user `8163e01b50d34b588932d259b84a1adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:03.580186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:03.587103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1185/2381] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:08.242793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dade29-e137-4984-be70-3a92dab43034 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:08.243306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dade29-e137-4984-be70-3a92dab43034 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:08.243417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dade29-e137-4984-be70-3a92dab43034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:08.262146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f1dade29-e137-4984-be70-3a92dab43034 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:08.263345 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f1dade29-e137-4984-be70-3a92dab43034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:08.270492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1197/2382] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:13:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:08.282964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:08.295653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3da51-c491-4905-ac64-75bf52779ffd None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:08.301256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:08.301898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:08.302183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:08.302462 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:08.310770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:08.312386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:08.321497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1186/2383] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:13:09.162589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9f8a-c8fe-4586-9413-1e68694f3e06 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:09.163041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9f8a-c8fe-4586-9413-1e68694f3e06 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:09.163501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb9f8a-c8fe-4586-9413-1e68694f3e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:09.183606 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bfeb9f8a-c8fe-4586-9413-1e68694f3e06 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:09.184989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bfeb9f8a-c8fe-4586-9413-1e68694f3e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:09.193259 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1198/2384] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:09.215826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:09.228526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a998b3-7f23-45e0-a1fe-7e27782653fd service swift] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:09.234508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:09.235361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:09.235863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:09.236264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:09.246736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:09.248434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:09.260865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1187/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:19.177454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=50 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:13:19.254091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=16 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:13:29.713200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:29.713788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:29.713788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:29.732067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:29.733312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:29.741839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1199/2386] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:29.774522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:29.785571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596150d-7537-4fca-917a-df262cd1a226 service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:29.791817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:29.792580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:29.792938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:29.793293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:29.802384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:29.804005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329623d-0636-45a9-b872-d8663cad6daf service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:29.813798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1188/2387] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:32.319060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:32.320596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:32.409260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a6a7-e943-468b-813b-ebc84564f579 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:32.414811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:32.415456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:32.415747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:32.416058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:32.417788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:32.429570 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:32.431285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:32.441475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1200/2388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:35.965512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdcfd-7f34-4096-9877-e5e8ac03ba02 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:35.966046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdcfd-7f34-4096-9877-e5e8ac03ba02 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:35.966046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fdcfd-7f34-4096-9877-e5e8ac03ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:35.984405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-056fdcfd-7f34-4096-9877-e5e8ac03ba02 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:35.985615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-056fdcfd-7f34-4096-9877-e5e8ac03ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:35.993506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1189/2389] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:36.023335 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:36.035283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608962-45d6-42d3-b645-191f56f1c90c service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:36.041320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:36.041951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:36.042240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:36.042575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:36.050716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:36.052313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:36.061576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1201/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:42.239253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:42.239730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:42.240356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:42.260793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:42.261998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:42.270338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1190/2391] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:42.321811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:42.333213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27965d8-df91-4859-a463-ebac021642cd service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:42.338778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:42.339478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:42.339719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:42.340045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:42.349015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:42.351125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43659b16-c41e-41fa-9ff1-e8bdb40efd94 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:42.361422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1202/2392] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:46.410603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:46.412067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:46.467839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ae42-6eb7-46d7-9a64-2c18ad050aed None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:46.471386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299159-0682-4445-a036-5716b0738242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:46.472050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299159-0682-4445-a036-5716b0738242 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:46.472337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299159-0682-4445-a036-5716b0738242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:46.472612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299159-0682-4445-a036-5716b0738242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:46.481505 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299159-0682-4445-a036-5716b0738242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:46.482915 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299159-0682-4445-a036-5716b0738242 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:46.492891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1191/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:13:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:13:48.810020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a303-1463-43e4-b674-87b476aa8ac1 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:48.813199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a303-1463-43e4-b674-87b476aa8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:48.815260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a303-1463-43e4-b674-87b476aa8ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:48.920860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-46f3a303-1463-43e4-b674-87b476aa8ac1 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:13:48.923358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-46f3a303-1463-43e4-b674-87b476aa8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:13:48.946614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1203/2394] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:13:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:13:48.985857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299159-0682-4445-a036-5716b0738242 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:13:49.026615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299159-0682-4445-a036-5716b0738242 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:13:49.034447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:13:49.035756 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:13:49.036517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:13:49.037021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:13:49.048799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:13:49.050759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bfe75-e11d-4026-b544-e6cd4c363de7 service swift] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:13:49.061780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1192/2395] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:13:58.942274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=74 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:13:59.057558 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=48 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:14:03.803449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14599-6759-4b37-a173-acf7033e12a9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:03.804539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14599-6759-4b37-a173-acf7033e12a9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:03.804711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b14599-6759-4b37-a173-acf7033e12a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:03.823319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-52b14599-6759-4b37-a173-acf7033e12a9 None None] MFA Rules not processed for user `bff510026042435e9ca0596c9727198a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:03.825052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-52b14599-6759-4b37-a173-acf7033e12a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:03.878225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1204/2396] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:14:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:05.488814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ada-a662-4bfc-b360-cac452b86540 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.490894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ada-a662-4bfc-b360-cac452b86540 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.492224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322ada-a662-4bfc-b360-cac452b86540 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.494579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1193/2397] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:14:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:14:05.504576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e7a-9367-49f2-96ae-2d2a33f02421 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.505130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e7a-9367-49f2-96ae-2d2a33f02421 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.505130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e7a-9367-49f2-96ae-2d2a33f02421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.568314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2fac0e7a-9367-49f2-96ae-2d2a33f02421 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:05.568314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2fac0e7a-9367-49f2-96ae-2d2a33f02421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:05.582261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1205/2398] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:14:05.607040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322ada-a662-4bfc-b360-cac452b86540 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:05.635391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322ada-a662-4bfc-b360-cac452b86540 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:05.638916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:05.639621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.639928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.640291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.651989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:05.653433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb44ae-1138-44ca-90e9-c8b283fe0072 service glance] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:05.664633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1194/2399] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:05.737961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235946-06c7-4806-baa9-791eb95dd30f None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.738258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235946-06c7-4806-baa9-791eb95dd30f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.739219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235946-06c7-4806-baa9-791eb95dd30f None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.741067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1206/2400] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:14:05.749092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaec69-95a1-402a-9e57-75a7570b1f98 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.749620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaec69-95a1-402a-9e57-75a7570b1f98 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.750149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaec69-95a1-402a-9e57-75a7570b1f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.780786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ddaaec69-95a1-402a-9e57-75a7570b1f98 None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:05.783030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ddaaec69-95a1-402a-9e57-75a7570b1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:05.791007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1195/2401] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:14:05.802654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57235946-06c7-4806-baa9-791eb95dd30f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:05.813802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57235946-06c7-4806-baa9-791eb95dd30f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:05.817365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:05.818006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.818510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.818807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.827665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:05.829155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622da64c-1838-49d0-aa93-d6601f1189ea service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:05.839453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1207/2402] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:05.980038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01274a0-ac2d-4807-b6c3-8ad0e774be47 None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.980331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01274a0-ac2d-4807-b6c3-8ad0e774be47 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.980611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01274a0-ac2d-4807-b6c3-8ad0e774be47 None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:05.982000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1196/2403] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:14:05.988226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528c96-1586-4abf-9848-8b616443a640 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:05.988525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528c96-1586-4abf-9848-8b616443a640 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:05.988838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b528c96-1586-4abf-9848-8b616443a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:06.010218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3b528c96-1586-4abf-9848-8b616443a640 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:06.011423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3b528c96-1586-4abf-9848-8b616443a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:06.020830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1208/2404] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:14:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:06.031339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01274a0-ac2d-4807-b6c3-8ad0e774be47 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:06.042460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01274a0-ac2d-4807-b6c3-8ad0e774be47 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:06.046077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:06.046714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:06.046998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:06.047276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:06.058429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:06.059854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:06.071596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1197/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:11.324982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be13b-542a-4820-a92e-51a6d28c68ae None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:11.325387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be13b-542a-4820-a92e-51a6d28c68ae None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:11.325862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087be13b-542a-4820-a92e-51a6d28c68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:11.345094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-087be13b-542a-4820-a92e-51a6d28c68ae None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:11.346466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-087be13b-542a-4820-a92e-51a6d28c68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:11.355289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1209/2406] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:11.367793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:11.380209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ce395-6c4d-4645-9d68-6dcaf0200b57 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:11.385931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:11.386580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:11.386870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:11.387184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:11.395784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:11.397411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:11.405748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1198/2407] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:14:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:14:21.339593 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=46 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:14:21.402328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=25 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:14:38.101059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27400eb-f87e-4e62-a88f-84b6ff276dc2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:38.101572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27400eb-f87e-4e62-a88f-84b6ff276dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:38.102111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27400eb-f87e-4e62-a88f-84b6ff276dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:38.122443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b27400eb-f87e-4e62-a88f-84b6ff276dc2 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:38.123647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b27400eb-f87e-4e62-a88f-84b6ff276dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:38.131655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1210/2408] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:14:38.156159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:38.169101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd002f03-e266-4527-8f09-1dc693bd3ed9 service swift] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:38.174286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:38.174982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:38.175203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:38.175485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:38.185186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:38.186776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:38.196198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1199/2409] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 09:14:40.575854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312390ac-0120-49bb-bb2f-9ae086f6f350 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:40.576424 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312390ac-0120-49bb-bb2f-9ae086f6f350 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:40.576524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312390ac-0120-49bb-bb2f-9ae086f6f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:40.595629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-312390ac-0120-49bb-bb2f-9ae086f6f350 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:40.596922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-312390ac-0120-49bb-bb2f-9ae086f6f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:40.605746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1211/2410] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:40.630801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:40.643331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d435af-49ff-4108-aa4a-efe6e21eb29d service swift] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:40.648859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:40.650143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:40.650433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:40.650714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:40.658875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:40.660497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:40.669913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1200/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:44.827227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fddf-07a5-4018-bba2-842f58a4bd0a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:44.827786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fddf-07a5-4018-bba2-842f58a4bd0a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:44.827786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fddf-07a5-4018-bba2-842f58a4bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:44.845365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-1901fddf-07a5-4018-bba2-842f58a4bd0a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:44.846561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1901fddf-07a5-4018-bba2-842f58a4bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:44.854397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1212/2412] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:44.878348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:44.890093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049583f-a409-440c-8fcd-050fc123998a service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:44.895658 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737f582-0821-484a-840f-888e7739150d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:44.896338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f582-0821-484a-840f-888e7739150d service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:44.896623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f582-0821-484a-840f-888e7739150d service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:44.896903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737f582-0821-484a-840f-888e7739150d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:44.905041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737f582-0821-484a-840f-888e7739150d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:44.906606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737f582-0821-484a-840f-888e7739150d service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:44.916072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1201/2413] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:48.916971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c6af-bc49-4e11-884a-18be5893d34b None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:48.917518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c6af-bc49-4e11-884a-18be5893d34b None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:48.917655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c6af-bc49-4e11-884a-18be5893d34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:48.936016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-5e41c6af-bc49-4e11-884a-18be5893d34b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:48.937237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5e41c6af-bc49-4e11-884a-18be5893d34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:48.945227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1213/2414] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:48.967793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737f582-0821-484a-840f-888e7739150d service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:48.979327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737f582-0821-484a-840f-888e7739150d service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:48.984812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:48.985442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:48.985722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:48.985994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:48.994009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:48.996140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:49.005379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1202/2415] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:53.107286 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b8f-7480-435e-a681-f7233e200447 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:53.107772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b8f-7480-435e-a681-f7233e200447 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:53.107887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3b8f-7480-435e-a681-f7233e200447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:53.125425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-de7c3b8f-7480-435e-a681-f7233e200447 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:53.126607 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-de7c3b8f-7480-435e-a681-f7233e200447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:53.134281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1214/2416] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:53.157244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:53.168905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0389-e455-44dc-ab79-6671f230d7ea service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:53.175508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:53.176228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:53.176519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:53.176803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:53.185569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:53.187160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4386d-e287-4cf9-80ec-7297f31187b5 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:53.196555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1203/2417] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:14:57.467579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:57.468146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:57.468254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:57.486120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] MFA Rules not processed for user `77ef8043cfee4a97bc6990264dbd7b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:57.487406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:57.543668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1215/2418] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:58.317829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:58.318325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:58.318439 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:58.336865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:14:58.338079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:14:58.346532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1204/2419] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jun 23 09:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:14:58.369002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:14:58.381822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c66c89-18d3-4c08-a750-fe3577fc1f85 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:14:58.387574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:14:58.388262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:14:58.388555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:14:58.388841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:14:58.397548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:14:58.399143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:14:58.409361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1216/2420] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:08.332115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=33 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:08.404973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=46 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:17.862223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:17.871708 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6b62a-18b8-4568-88e4-54aafaaa9c81 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:17.875309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:17.875941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:17.876253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:17.876535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:17.878308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:17.891186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:17.892633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:17.903833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1205/2421] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:21.409222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:21.420312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48720010-8ca8-44bb-8c14-93a61a4ef65f service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:21.423883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:21.424547 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:21.424832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:21.425110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:21.426848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:21.440463 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:21.441940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:21.453457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1217/2422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:25.154526 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:25.165591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfed0a-11d1-4c77-9dd2-e30c1f40a03e service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:25.171943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:25.172669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:25.173009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:25.173287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:25.175122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:25.234840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:25.236470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:25.245577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1206/2423] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:31.447854 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:35.241392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=34 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:35.588337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:35.590364 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:35.604885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b09bfd-2b74-4f40-ba29-b0a5c743320e service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:35.609316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:35.610202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:35.610484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:35.610760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] PATH_INFO: `/v3/users/bff510026042435e9ca0596c9727198a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:35.611989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff510026042435e9ca0596c9727198a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:35.613897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:35.661057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff510026042435e9ca0596c9727198a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:35.668918 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff510026042435e9ca0596c9727198a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:35.669580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff510026042435e9ca0596c9727198a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:35.676522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff510026042435e9ca0596c9727198a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:35.677138 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff510026042435e9ca0596c9727198a'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:35.695023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1218/2424] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:15:35 2022] DELETE /identity/v3/users/bff510026042435e9ca0596c9727198a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:15:35.904491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:35.914989 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc28950-123e-4e5c-bd59-60dd1baa70bf service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:35.977894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:35.978770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:35.979056 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:35.980031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] PATH_INFO: `/v3/projects/40c05667a6bf4c9388d8ac779fa1ba81` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:35.981281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c05667a6bf4c9388d8ac779fa1ba81)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:35.983274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:36.029062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c05667a6bf4c9388d8ac779fa1ba81', 'request_id': 'req-e11e18bd-65b7-4486-af11-0d69f5197b47'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:36.034472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c05667a6bf4c9388d8ac779fa1ba81', 'request_id': 'req-e11e18bd-65b7-4486-af11-0d69f5197b47'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:36.042377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c05667a6bf4c9388d8ac779fa1ba81', 'request_id': 'req-e11e18bd-65b7-4486-af11-0d69f5197b47'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:36.053308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] The token cache is being invalidate because project 40c05667a6bf4c9388d8ac779fa1ba81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:15:36.053595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:36.054210 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-e11e18bd-65b7-4486-af11-0d69f5197b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:15:36.055727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1207/2425] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:15:35 2022] DELETE /identity/v3/projects/40c05667a6bf4c9388d8ac779fa1ba81 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:15:45.691511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:46.015416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:46.016885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:46.050309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:46.090242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc956d5-f568-4242-8fb2-0daa68ce4a6f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:46.153945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:46.154603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:46.154893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:46.155172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:46.157054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:46.216076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:46.217653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:46.226612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1219/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:54.308639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:54.309403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:54.309403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:54.327905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] MFA Rules not processed for user `20a6d94b2d03465cb3e7619609084680`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:15:54.329138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:54.336101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1208/2427] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:15:54.629993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:54.631400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:54.670812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:15:54.687336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2790-7ba6-4d74-bf51-36797a8f5074 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:54.691237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:54.691876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:54.692190 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:54.692464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:54.694230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:54.703745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:54.705232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:54.712945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1220/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:55.022103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:55.023538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:55.094956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221c7b6-e5e5-4f1e-b9a5-5b2098e0bb9d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:55.099847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:55.100519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:55.100807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:55.101089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:55.102866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:55.114474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:55.116061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:55.126899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1209/2429] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:57.036559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:57.038003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:57.049000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66658090-a3a4-4da5-8659-8b6ab81505a4 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:57.052599 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:57.053235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:57.053548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:57.053828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:57.055511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:57.064720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:57.066198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:57.074544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1221/2430] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:15:57.769749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:15:57.771841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:57.788706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4def-bd7a-440d-8d2f-88f4da2dd480 service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:15:57.796255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:15:57.796853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:15:57.797142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:15:57.797423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:15:57.799415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:15:57.813624 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:15:57.815295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:15:57.827923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1210/2431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:15:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:03.939119 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:03.953142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f566e-d54c-47fb-a0eb-2506fe415a53 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:03.958644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:03.959292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:03.959578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:03.959899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:03.961712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:03.973931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:03.975499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:03.986618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1222/2432] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:07.797663 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:07.799198 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:07.813673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160318d1-5949-4b8d-ab2e-4917b3b7ae06 service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:07.819551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:07.820228 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:07.820520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:07.820802 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:07.822586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:07.835572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:07.837189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:07.847868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1211/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:10.134446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:10.135930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:10.214347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1963f-bde8-42b3-b0b8-9df1b72ab9d6 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:10.218139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:10.218782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:10.219070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:10.219350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:10.221178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:10.278713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:10.280163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:10.289353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1223/2434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:17.843393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=47 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:20.285014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=79 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:28.831550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:28.841014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc332ad-f463-4121-962c-ab2db1c81297 service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:28.845337 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:28.845981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:28.846272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:28.846556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:28.848352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:28.910829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:28.912295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:28.921974 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1212/2435] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:32.165238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.166804 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:32.181636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90192e4-cfd1-433f-88b2-58be60430713 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.186278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.187186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.187491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.187753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] PATH_INFO: `/v3/users/77ef8043cfee4a97bc6990264dbd7b00` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.189016 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ef8043cfee4a97bc6990264dbd7b00)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.190999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.242614 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ef8043cfee4a97bc6990264dbd7b00'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.252253 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ef8043cfee4a97bc6990264dbd7b00'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.253026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ef8043cfee4a97bc6990264dbd7b00'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.261354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ef8043cfee4a97bc6990264dbd7b00'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.262087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-84c71ead-f84d-440e-a1be-7be503660e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ef8043cfee4a97bc6990264dbd7b00'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.282006 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1224/2436] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:16:32 2022] DELETE /identity/v3/users/77ef8043cfee4a97bc6990264dbd7b00 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:16:32.480849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.491589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb3ff8-efed-4aa6-b59f-c4d46c018c2d service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.549267 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.550130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.550418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.550698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] PATH_INFO: `/v3/projects/69a9977bb52a434b844fef508dca3737` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.551911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a9977bb52a434b844fef508dca3737)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.553850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.603046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a9977bb52a434b844fef508dca3737', 'request_id': 'req-c706648f-f052-4af9-89c0-8bbe59f6ae25'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.608922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a9977bb52a434b844fef508dca3737', 'request_id': 'req-c706648f-f052-4af9-89c0-8bbe59f6ae25'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.616204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a9977bb52a434b844fef508dca3737', 'request_id': 'req-c706648f-f052-4af9-89c0-8bbe59f6ae25'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.627795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] The token cache is being invalidate because project 69a9977bb52a434b844fef508dca3737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:16:32.628129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.628759 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c706648f-f052-4af9-89c0-8bbe59f6ae25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:16:32.630323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1213/2437] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:16:32 2022] DELETE /identity/v3/projects/69a9977bb52a434b844fef508dca3737 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:16:32.635440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.635734 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.636100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.654506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:32.655646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:32.713292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1225/2438] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:16:32.721355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.721651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.721932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.739916 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:32.741176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:32.749612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1214/2439] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:16:32.753735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.763464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29be43d-6afd-4190-9f4a-5a920169421e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.768934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.769596 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.769886 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.770170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.770902 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:16:32.771216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.772901 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.784581 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1226/2440] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:16:32.788697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.797816 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd8115-b1dd-40a1-9d71-c73e1b39a4f2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.802450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.803092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.803419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.803705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.804456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.806362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.820880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:32.843434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1215/2441] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:16:32 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:16:32.847566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.857636 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e13a6-bb91-41ae-b963-2e9fbbe5eef7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.913598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.914199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.914506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.914786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.915481 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.917467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.924590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:32.938824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1227/2442] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:16:32 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:16:32.942814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.953325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68375600-3368-4ad6-92bc-c90ed335e2e2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.957976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.958651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.958933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.959212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.959944 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.961559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:32.971883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1216/2443] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:16:32.975672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:32.986242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffd938-a2a9-4f2a-a4d6-266c055ee23c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:32.990872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:32.991520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:32.991810 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:32.992128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:32.992860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:32.994458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328361b7-b709-4cf8-825a-c8799c991c56 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.004229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1228/2444] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:16:33.008260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.019162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b29110-8f47-404d-b362-9ca35b8ffde7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.023860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.024767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.025057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.025344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] PATH_INFO: `/v3/projects/5560f73c1f7542318e58f25d67e0b7db/users/475581d7544c4f97bc63d23ce851ee62/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.042127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5560f73c1f7542318e58f25d67e0b7db, user_id=475581d7544c4f97bc63d23ce851ee62, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.044836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.057357 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1217/2445] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:16:33 2022] PUT /identity/v3/projects/5560f73c1f7542318e58f25d67e0b7db/users/475581d7544c4f97bc63d23ce851ee62/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:16:33.067464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.067785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.068097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.095240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] MFA Rules not processed for user `475581d7544c4f97bc63d23ce851ee62`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:33.096513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:33.158580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1229/2446] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:16:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:16:33.163159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.225563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f84ce-83d1-407f-b4bc-0b7d210c8292 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.230314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.230967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.231251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.231530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.232250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.234132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.258549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1218/2447] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:16:33 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:16:33.262736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.273695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de8eac-3aaf-4b07-8524-9390fb4e6fc9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.329776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.330445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.330735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.331015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.331722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.333705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.353772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1230/2448] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:16:33 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:16:33.357776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.367921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6c0be-37a3-4572-a770-f56660778c20 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.372500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.373679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.374000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.374227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.374959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.376577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.387413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1219/2449] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:16:33.392229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.402591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e9e0b-388c-4a21-a351-5afe9410c7cb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.407388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.408428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.408813 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.409112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] PATH_INFO: `/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b/users/600fee7162f54d86baf0890dc8cf4492/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.424915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b1b831f8f3420fb0b15e2a5ed8671b, user_id=600fee7162f54d86baf0890dc8cf4492, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.427710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.441699 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1231/2450] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:16:33 2022] PUT /identity/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b/users/600fee7162f54d86baf0890dc8cf4492/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:16:33.445733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.457410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6df86-d360-4b67-be86-950dd0b6094c admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.516110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.516783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.517071 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.517354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.518091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.519723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93d5b1-1f69-446d-a5ff-1726ea21337b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.529442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1220/2451] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:16:33.533878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.544302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f5756-b0d9-43a0-88e8-c140dd6f42cf admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.548934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.549809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.550097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.550377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] PATH_INFO: `/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b/users/600fee7162f54d86baf0890dc8cf4492/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.552413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b1b831f8f3420fb0b15e2a5ed8671b, user_id=600fee7162f54d86baf0890dc8cf4492, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.555049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.566014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1232/2452] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:16:33 2022] PUT /identity/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b/users/600fee7162f54d86baf0890dc8cf4492/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:16:33.576143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.577050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.577336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.603390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] MFA Rules not processed for user `600fee7162f54d86baf0890dc8cf4492`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:33.604629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:33.613784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:33.678758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1221/2453] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:16:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:16:33.691880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.693630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:33.718041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:33.752658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433bfcd-8848-450e-936a-b71b354b43d9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.756298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.756929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.757211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.757486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.766873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.768321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45ebc9-e918-47e8-8ec6-da669fb8331e service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.777552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1233/2454] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:33.849782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:33.860044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94a931-43c4-45ec-a395-b79cc52f7809 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:33.863594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:33.864262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:33.864548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:33.864827 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:33.918764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:33.920731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fa5ce-86b6-4dee-91a6-ff9cab36c608 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:33.929448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1222/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:16:42.769003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:42.769483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:42.769580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:42.787113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] MFA Rules not processed for user `cc4f7b9f69ab47a39e1219a0605e7049`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:42.788337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:42.842038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1234/2456] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:16:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:16:43.925548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=52 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:52.835042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=42 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:16:55.620782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:55.621265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:55.621371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:55.639985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:16:55.641189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:55.694740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1223/2457] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:16:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:16:55.741094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:55.742503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:55.821855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b5ef0-fe22-4d16-a4f6-ad11ae3eae54 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:55.827513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:55.828180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:55.828468 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:55.828739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:55.837022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:55.838591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:55.847218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1235/2458] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:16:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:16:59.541234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:16:59.543467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:59.689758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c1e34-884c-415b-9965-5b95f3208aae None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:16:59.694865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:16:59.695606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:16:59.695984 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:16:59.696278 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:16:59.698184 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:16:59.711104 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:16:59.712841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:16:59.724862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1224/2459] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:16:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:03.236698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:03.251544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58a84d-4924-467e-b39b-b6f3e2fc2a21 service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:03.257853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:03.258867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:03.259316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:03.259798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:03.262164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:03.277227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:03.279293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:03.296393 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1236/2460] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:03.337966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:03.346485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:03.449341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a1014-e526-48ff-8f80-48d81c8a479f service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:03.456628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:03.457877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:03.458384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:03.458839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] PATH_INFO: `/v3/users/8163e01b50d34b588932d259b84a1adb` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:03.460409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8163e01b50d34b588932d259b84a1adb)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:03.462649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:03.541249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:03.557022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8163e01b50d34b588932d259b84a1adb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.557702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8163e01b50d34b588932d259b84a1adb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.565377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8163e01b50d34b588932d259b84a1adb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.574221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8163e01b50d34b588932d259b84a1adb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.575197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8163e01b50d34b588932d259b84a1adb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.595993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1225/2461] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:03 2022] DELETE /identity/v3/users/8163e01b50d34b588932d259b84a1adb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:03.777103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:03.790161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81fa4-eed9-40eb-9d93-03ea235a320b service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:03.860983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:03.861860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:03.862166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:03.862444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] PATH_INFO: `/v3/projects/9f083759f0d1493abe1b4e3287c18188` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:03.863659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f083759f0d1493abe1b4e3287c18188)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:03.865634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:03.913218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f083759f0d1493abe1b4e3287c18188', 'request_id': 'req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.921751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f083759f0d1493abe1b4e3287c18188', 'request_id': 'req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.928659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f083759f0d1493abe1b4e3287c18188', 'request_id': 'req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.930563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:03.942883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] The token cache is being invalidate because project 9f083759f0d1493abe1b4e3287c18188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:03.943479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.944519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:03.947230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1237/2462] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:03 2022] DELETE /identity/v3/projects/9f083759f0d1493abe1b4e3287c18188 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:03.951499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:03.953284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:03.966520 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc485c08-92ac-4998-8427-2912b3ae6629 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.025518 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.026406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.026694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.027005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] PATH_INFO: `/v3/users/1862692c820a4874952de18d0af9cc04` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.028268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1862692c820a4874952de18d0af9cc04)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.030238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.077396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1862692c820a4874952de18d0af9cc04'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.078046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1862692c820a4874952de18d0af9cc04'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.085493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1862692c820a4874952de18d0af9cc04'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.094860 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1862692c820a4874952de18d0af9cc04'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.095511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5ed3dbc0-3bd9-4905-8e37-c370841330d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1862692c820a4874952de18d0af9cc04'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.113387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1226/2463] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:03 2022] DELETE /identity/v3/users/1862692c820a4874952de18d0af9cc04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:04.292278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.294248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.321201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65ec1-ac34-42a6-a468-918b0aa6cfd3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.388211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.389083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.390123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.390407 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] PATH_INFO: `/v3/projects/afd71cdedd1d4126b2cf32113b95180b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.392765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd71cdedd1d4126b2cf32113b95180b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.394711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.447172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd71cdedd1d4126b2cf32113b95180b', 'request_id': 'req-3279e380-f004-4b76-ad8f-e4ec6ee661da'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.456807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd71cdedd1d4126b2cf32113b95180b', 'request_id': 'req-3279e380-f004-4b76-ad8f-e4ec6ee661da'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.463399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd71cdedd1d4126b2cf32113b95180b', 'request_id': 'req-3279e380-f004-4b76-ad8f-e4ec6ee661da'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.474417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] The token cache is being invalidate because project afd71cdedd1d4126b2cf32113b95180b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:04.474642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.475294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-3279e380-f004-4b76-ad8f-e4ec6ee661da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.476930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1238/2464] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:04 2022] DELETE /identity/v3/projects/afd71cdedd1d4126b2cf32113b95180b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:04.482141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.483593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.483878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.503305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:04.504592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.534445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:04.568077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1227/2465] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:04.578178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.578506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.578838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.602069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:04.603305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.607543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.609479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.611800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1239/2466] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:04.615685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.621680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2605ad0-d110-43ad-b2a9-109679c1f123 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.624741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39819c-cfa8-4cf9-8bbc-74897903baf2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.626342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.627205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.627488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.627763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] PATH_INFO: `/v3/users/475581d7544c4f97bc63d23ce851ee62` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.629002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=475581d7544c4f97bc63d23ce851ee62)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.629459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.630094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.630382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.630660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.630911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.631380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:04.631689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.633300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.645666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1240/2467] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:17:04.650033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.661696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a747ee2-5c04-4ccf-a7f3-65351b6ac187 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.666891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.667647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.667973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.668263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.668971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.670905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.680490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475581d7544c4f97bc63d23ce851ee62'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.681171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475581d7544c4f97bc63d23ce851ee62'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.688662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475581d7544c4f97bc63d23ce851ee62'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.696907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1241/2468] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:04.697531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475581d7544c4f97bc63d23ce851ee62'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.698182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-28409575-ae61-4b2d-bf98-1f961b383e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475581d7544c4f97bc63d23ce851ee62'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:04.701474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.703684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.716961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1228/2469] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:04 2022] DELETE /identity/v3/users/475581d7544c4f97bc63d23ce851ee62 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:04.721856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.722309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.722594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.740723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:04.742011 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.750111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:04.769298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a2339-3e39-495b-86cb-9ea00a70bb8b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.802106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1229/2470] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:17:04.812607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.814243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:04.825471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.826174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.826465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.827336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.828065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.830023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.852477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1242/2471] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:04.856519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.865878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546b2f-7acf-4fd7-bd9a-ac95588f1535 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.867358 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:04.870814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.871475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.871777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.872072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.872799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.874752 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b1f8-9b60-40b5-b6a6-42ea6bcf0722 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.874953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.879421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.880160 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.880446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.880722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.887829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1243/2472] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:04.889053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.890688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.892141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.899107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843c08-3f19-4366-a177-9091778f2069 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.901751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1230/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:17:04.903806 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.904475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.904792 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.905073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.905793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.907363 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62ae5c-e8bc-4bc2-95e7-5c1bc731cf82 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.918972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1244/2474] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:04.923271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:04.933085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45d1cf-b531-48bd-be76-0f69bf66f26d service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:04.938428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:04.939302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.939584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.939863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] PATH_INFO: `/v3/projects/310d86656be5457490e48e2fa22ea537/users/139816304d534626b03e45afa6517530/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.956400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310d86656be5457490e48e2fa22ea537, user_id=139816304d534626b03e45afa6517530, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:04.959155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:04.971355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1231/2475] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:04 2022] PUT /identity/v3/projects/310d86656be5457490e48e2fa22ea537/users/139816304d534626b03e45afa6517530/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:04.976876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:04.977167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:04.977452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:04.995283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:04.996744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:05.064707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1245/2476] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:05.074147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:05.133105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd615-f728-4ca2-86ca-538c2a108cf7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:05.137550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:05.138221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:05.138508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:05.138795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:05.149498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:05.150932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:05.160796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1232/2477] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:05.185798 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:05.188059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:05.203128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a751683-1577-4ac6-b005-71fb766af8e6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:05.207936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:05.208856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:05.209143 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:05.209931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] PATH_INFO: `/v3/projects/5560f73c1f7542318e58f25d67e0b7db` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:05.211334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5560f73c1f7542318e58f25d67e0b7db)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:05.213284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:05.267903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5560f73c1f7542318e58f25d67e0b7db', 'request_id': 'req-2da87e05-6f05-4fb3-b812-28726ed2941d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.272115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:05.277301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5560f73c1f7542318e58f25d67e0b7db', 'request_id': 'req-2da87e05-6f05-4fb3-b812-28726ed2941d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.284621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5560f73c1f7542318e58f25d67e0b7db', 'request_id': 'req-2da87e05-6f05-4fb3-b812-28726ed2941d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.297474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] The token cache is being invalidate because project 5560f73c1f7542318e58f25d67e0b7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:05.298133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.298717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.300348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1246/2478] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:05 2022] DELETE /identity/v3/projects/5560f73c1f7542318e58f25d67e0b7db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:05.304362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:05.315437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f1f37-b4b7-441f-827f-b4709aaf4cfa service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:05.388447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:05.389370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:05.389765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:05.389981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] PATH_INFO: `/v3/users/600fee7162f54d86baf0890dc8cf4492` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:05.391568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600fee7162f54d86baf0890dc8cf4492)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:05.393896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:05.447231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600fee7162f54d86baf0890dc8cf4492'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.447923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600fee7162f54d86baf0890dc8cf4492'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.455334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600fee7162f54d86baf0890dc8cf4492'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.463009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600fee7162f54d86baf0890dc8cf4492'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.463814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-74b12cb3-de07-44bb-85dd-e41554c388c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600fee7162f54d86baf0890dc8cf4492'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.469371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:05.488038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1233/2479] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:05 2022] DELETE /identity/v3/users/600fee7162f54d86baf0890dc8cf4492 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:05.777791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:05.779167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:05.799373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da87e05-6f05-4fb3-b812-28726ed2941d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:05.871145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:05.872056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:05.872398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:05.872696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] PATH_INFO: `/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:05.873941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b1b831f8f3420fb0b15e2a5ed8671b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:05.875910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:05.927341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b1b831f8f3420fb0b15e2a5ed8671b', 'request_id': 'req-b6f214ea-6e12-46ec-afdb-d8914dd19667'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.936264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b1b831f8f3420fb0b15e2a5ed8671b', 'request_id': 'req-b6f214ea-6e12-46ec-afdb-d8914dd19667'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.942556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b1b831f8f3420fb0b15e2a5ed8671b', 'request_id': 'req-b6f214ea-6e12-46ec-afdb-d8914dd19667'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.955494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] The token cache is being invalidate because project f6b1b831f8f3420fb0b15e2a5ed8671b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:05.955788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.956471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-b6f214ea-6e12-46ec-afdb-d8914dd19667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:05.958040 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1247/2480] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:05 2022] DELETE /identity/v3/projects/f6b1b831f8f3420fb0b15e2a5ed8671b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:05.963039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:05.963451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:05.963811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:05.986330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:05.987653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:06.068459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1234/2481] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:06.076487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.077325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.077608 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.100001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:06.101796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:06.112429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1248/2482] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:06.117167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.128148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f7a8d-9117-4db6-8860-1f62e4cd122f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.132852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.133515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.133920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.134204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.134941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:06.135255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.136914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.153533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1235/2483] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:17:06.155701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.168001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7479-35ec-4cd9-b5e0-e82984caebb6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.172623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.173293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.173601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.173869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.174701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.176685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.211153 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1249/2484] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:06.212219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.228302 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0099-a6f4-47e9-b6ca-e5f1f0cdd59a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.298962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.300457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.300761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.301047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.302467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.308987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.336086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1236/2485] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:06.338425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.350437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb924-d0bd-4aaf-a3f0-e332cffb7cc6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.355661 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.356402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.356694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.356980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.357927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.359623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.374075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1250/2486] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:06.375397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.388325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3ff1a-35af-414c-b9e6-837de9b5a7d8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.396502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.396795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.397090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.397396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.398150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.400269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca03f13-c278-4959-ab01-244beb8e3b0a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.411399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1237/2487] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:06.415755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.426722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403c2a6-c7c0-42b1-8f09-54394580e83b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.434009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.435175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.435679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.436693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] PATH_INFO: `/v3/projects/971a841e2ca04483983ea1db2a7b83ad/users/7bb6114521234f498eea70f29307c80b/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.457711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=971a841e2ca04483983ea1db2a7b83ad, user_id=7bb6114521234f498eea70f29307c80b, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.460779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.477827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1251/2488] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:06 2022] PUT /identity/v3/projects/971a841e2ca04483983ea1db2a7b83ad/users/7bb6114521234f498eea70f29307c80b/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:06.488826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.489688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.490128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.529095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] MFA Rules not processed for user `7bb6114521234f498eea70f29307c80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:06.530366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:06.580118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:06.615016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1238/2489] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:06.619246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.631824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:06.697894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c172fb6-70a2-4492-a629-cd855e211afb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.703434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.709778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.709778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.709778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.709778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.709778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.763090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1252/2490] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:06.764618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.777448 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c64ce9-6de3-4a82-b9db-e976fca46559 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.840613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.841674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.841674 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.841910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.843836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.845993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.871605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1239/2491] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:06 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:06.873076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.884438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa458156-0cf9-49d1-823a-caa7caca0f07 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.889184 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.889914 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.890267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.890612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.891430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.893159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.903864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1253/2492] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:06.908092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.921119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461afae1-3cb7-40ba-aeb7-38bad931f343 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:06.929739 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:06.930826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:06.931111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:06.931578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] PATH_INFO: `/v3/projects/220648a79fe944ea88a3ca7d92058e5c/users/eaa6c4a07cd14b259b8d3562db8af5a3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:06.947487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=220648a79fe944ea88a3ca7d92058e5c, user_id=eaa6c4a07cd14b259b8d3562db8af5a3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:06.950469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:06.963735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1240/2493] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:06 2022] PUT /identity/v3/projects/220648a79fe944ea88a3ca7d92058e5c/users/eaa6c4a07cd14b259b8d3562db8af5a3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:06.967667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:06.977523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7047f1b-1293-46c6-8336-e342057dc64f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:07.040705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:07.041765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:07.042055 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:07.042338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:07.043078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:07.044950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0553fa2-a40e-4c4d-b2f8-a1aeed69f7c9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:07.056809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1254/2494] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:07.061640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:07.072367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee82e64-2033-4f76-b492-d1528f1e00ca admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:07.077673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:07.078700 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:07.078994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:07.079279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] PATH_INFO: `/v3/projects/220648a79fe944ea88a3ca7d92058e5c/users/eaa6c4a07cd14b259b8d3562db8af5a3/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:07.081307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=220648a79fe944ea88a3ca7d92058e5c, user_id=eaa6c4a07cd14b259b8d3562db8af5a3, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:07.083967 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:07.094566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1241/2495] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:07 2022] PUT /identity/v3/projects/220648a79fe944ea88a3ca7d92058e5c/users/eaa6c4a07cd14b259b8d3562db8af5a3/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:07.104578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:07.104996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:07.105293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:07.132950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] MFA Rules not processed for user `eaa6c4a07cd14b259b8d3562db8af5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:07.134339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:07.215290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1255/2496] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:07.227609 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:07.229677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:07.296382 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4751f-7a88-4c65-ba3a-2b1726203c5b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:07.300398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:07.301179 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:07.301855 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:07.302088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:07.312899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:07.314445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff604fd-cb0d-473d-8b62-8b948df0f58c service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:07.325905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1242/2497] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:07.852781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:07.859750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:07.927019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b271d0-7596-4083-a5bf-e2358348728d None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:07.931430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:07.932342 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:07.932629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:07.932903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] PATH_INFO: `/v3/users/7bb6114521234f498eea70f29307c80b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:07.934103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb6114521234f498eea70f29307c80b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:07.936076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:08.012523 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb6114521234f498eea70f29307c80b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.023744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb6114521234f498eea70f29307c80b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.025038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb6114521234f498eea70f29307c80b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.041624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb6114521234f498eea70f29307c80b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.043179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb6114521234f498eea70f29307c80b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.068712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1256/2498] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:07 2022] DELETE /identity/v3/users/7bb6114521234f498eea70f29307c80b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:08.073315 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:08.073814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:08.073941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:08.093666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:08.095103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:08.134407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:08.175148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1243/2499] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:08.185701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:08.187254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:08.256735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91715-1645-4d66-9f1f-a9e67d819c0f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:08.260252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:08.260908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:08.261272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:08.261458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:08.282946 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:08.284473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:08.298151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1257/2500] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:08.663640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:08.665849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:08.688536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b427f9d-1910-4f9b-9a68-b47de9b97c02 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:08.693218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:08.694878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:08.695493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:08.695818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] PATH_INFO: `/v3/projects/971a841e2ca04483983ea1db2a7b83ad` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:08.697572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971a841e2ca04483983ea1db2a7b83ad)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:08.699611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:08.758089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971a841e2ca04483983ea1db2a7b83ad', 'request_id': 'req-36701477-a101-421e-98ca-8d7846780292'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.765788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971a841e2ca04483983ea1db2a7b83ad', 'request_id': 'req-36701477-a101-421e-98ca-8d7846780292'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.777344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971a841e2ca04483983ea1db2a7b83ad', 'request_id': 'req-36701477-a101-421e-98ca-8d7846780292'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.797403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] The token cache is being invalidate because project 971a841e2ca04483983ea1db2a7b83ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:08.797821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.798587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-36701477-a101-421e-98ca-8d7846780292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.803511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1244/2501] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:08 2022] DELETE /identity/v3/projects/971a841e2ca04483983ea1db2a7b83ad => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:08.805052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:08.818032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd6026-9b3c-431f-b911-d93010bb09b2 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:08.845978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:08.887344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:08.888399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:08.888793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:08.889314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] PATH_INFO: `/v3/users/eaa6c4a07cd14b259b8d3562db8af5a3` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:08.890900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa6c4a07cd14b259b8d3562db8af5a3)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:08.893075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:08.957783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa6c4a07cd14b259b8d3562db8af5a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.967907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa6c4a07cd14b259b8d3562db8af5a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.968862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa6c4a07cd14b259b8d3562db8af5a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.984793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa6c4a07cd14b259b8d3562db8af5a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:08.985859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa6c4a07cd14b259b8d3562db8af5a3'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.019974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1258/2502] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:08 2022] DELETE /identity/v3/users/eaa6c4a07cd14b259b8d3562db8af5a3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:09.197745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.198265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.198898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.234614 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] MFA Rules not processed for user `139816304d534626b03e45afa6517530`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:09.235881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.311856 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1245/2503] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:09.315451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.318931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.358021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.363481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.408628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d19ab6-8301-4212-b9fd-a2cfb1b54114 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.414536 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.415221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.415512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.415795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.416947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.418500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.433574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:09.460238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1259/2504] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:09.464695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.469478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7c877-eddf-4de1-a9f1-25c18188e1a6 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.513109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:09.553664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72c36d-dba6-4e77-9eba-33b91d450a47 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.554639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.555524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.555810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.556163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] PATH_INFO: `/v3/projects/220648a79fe944ea88a3ca7d92058e5c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.557511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220648a79fe944ea88a3ca7d92058e5c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.559424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.560416 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.562660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.563172 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.563858 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.564700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.567418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.603725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1260/2505] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:09.607672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.617817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd965-148b-4f1c-835c-ec295f6f9a8e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.629872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220648a79fe944ea88a3ca7d92058e5c', 'request_id': 'req-afd92e16-5edb-4392-ae18-9da497a270d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.638103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220648a79fe944ea88a3ca7d92058e5c', 'request_id': 'req-afd92e16-5edb-4392-ae18-9da497a270d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.647416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220648a79fe944ea88a3ca7d92058e5c', 'request_id': 'req-afd92e16-5edb-4392-ae18-9da497a270d4'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.661597 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] The token cache is being invalidate because project 220648a79fe944ea88a3ca7d92058e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:09.661890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.662580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-afd92e16-5edb-4392-ae18-9da497a270d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:09.668068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1246/2506] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:09 2022] DELETE /identity/v3/projects/220648a79fe944ea88a3ca7d92058e5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:09.669649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d980f0e-171a-48dc-9248-7ce8be5458ed None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.669941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d980f0e-171a-48dc-9248-7ce8be5458ed None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.670254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d980f0e-171a-48dc-9248-7ce8be5458ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.689298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9d980f0e-171a-48dc-9248-7ce8be5458ed None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:09.690542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9d980f0e-171a-48dc-9248-7ce8be5458ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.691247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.692039 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.692340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.692618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.693697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.695325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.699101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1247/2507] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:09.707720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1261/2508] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:09.711395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.711673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.711993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.712272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.714114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.727315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3238-27af-4247-886b-8034ea169a77 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.732300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.733917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.734154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.734426 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] PATH_INFO: `/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054/users/8a8f5596627144cfb640b7a7fb96de51/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.739821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:09.741190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:09.765115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1248/2509] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:17:09.766281 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.773288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab74e5c6e9bd41eb83bcdad8c5cb2054, user_id=8a8f5596627144cfb640b7a7fb96de51, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.778773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.781149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4ce7-14f5-4ebf-adc3-23146aafe7cc None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.786135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.786798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.787114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.787441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.788183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:09.788499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.790272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.794027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1262/2510] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:09 2022] PUT /identity/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054/users/8a8f5596627144cfb640b7a7fb96de51/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:09.798288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.803117 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1249/2511] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 09:17:09.807260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.821959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c968a-7b54-40ed-9b67-b48066331b95 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.872299 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ed00-a4b3-46a9-8372-b73f059a360e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.878131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.878934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.879322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.879720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.880609 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.882320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.890429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.891106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.891394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.891673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.892440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.893733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1263/2512] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:09.894441 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.897877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.899112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:09.910126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5198ec-ae79-4fe3-a870-719422f2d904 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:09.916791 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:09.917800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:09.918206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:09.918436 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] PATH_INFO: `/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054/users/8a8f5596627144cfb640b7a7fb96de51/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:09.921797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab74e5c6e9bd41eb83bcdad8c5cb2054, user_id=8a8f5596627144cfb640b7a7fb96de51, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:09.924853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:09.930115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1250/2513] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:09.933958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:09.940291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1264/2514] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:09 2022] PUT /identity/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054/users/8a8f5596627144cfb640b7a7fb96de51/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:10.014320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036714-6b30-407a-a3a2-2565378b71e5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.092414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.093474 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.093861 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.094239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.095106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.097213 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.121034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1251/2515] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:09 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:10.125831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.137845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549ea4-c810-4116-8e25-caeefa68bc75 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.144069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.144515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.144968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.145201 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.145932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.147522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.161278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1265/2516] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:10.165169 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.176875 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4874af0-a30d-4c56-8af8-c1082d61a06e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.182789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.183628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.183914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.184353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.185207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.187155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fcf55-4b99-43fe-b1ec-784f68240376 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.198585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1252/2517] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:10.202938 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.213628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:10.219744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e895efa-dce2-4ea6-bb40-771d8d4dd98b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.227638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.228929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.229314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.229878 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] PATH_INFO: `/v3/projects/a503a67b9a984d98bd8fac4764373699/users/ae13a306035844f9976015a1e7922ad7/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.255046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a503a67b9a984d98bd8fac4764373699, user_id=ae13a306035844f9976015a1e7922ad7, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.258292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.299520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1266/2518] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:10 2022] PUT /identity/v3/projects/a503a67b9a984d98bd8fac4764373699/users/ae13a306035844f9976015a1e7922ad7/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:10.310871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.311616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.311907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.354998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] MFA Rules not processed for user `ae13a306035844f9976015a1e7922ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:10.358651 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:10.474206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1253/2519] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:10.478344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.555285 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abb54f-f7d3-4e2e-b604-403f4347e01c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.561462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.562178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.562466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.562743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.563461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.565771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.599996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1267/2520] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:10 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:10.602412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.611147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:10.617701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308540-7bb8-4944-850c-4922d72b659d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.696415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.697216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.697498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.697955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.698681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.701065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.732338 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1254/2521] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:10 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:10.733427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.746466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b003ea6-9667-4a3f-8fab-d16b36fc17fa admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.753181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.753583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.754117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.754516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.755430 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.757347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.771742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1268/2522] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:17:10.776461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.789671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e217fb5-89e7-4c6d-b2a2-16655f25147e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.795744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.800037 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.800583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.801148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] PATH_INFO: `/v3/projects/452e2e8d2c804e459b1fff23ca217e5e/users/1be342abb8f94988be880ecf62a158af/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.823903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452e2e8d2c804e459b1fff23ca217e5e, user_id=1be342abb8f94988be880ecf62a158af, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.827781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.849743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1255/2523] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:10 2022] PUT /identity/v3/projects/452e2e8d2c804e459b1fff23ca217e5e/users/1be342abb8f94988be880ecf62a158af/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:10.853657 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.865730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cb52-2783-4591-9b64-2ca7aad6cb1c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.941043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.941877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.942214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.943072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.943389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.945090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9324a-17bb-4ffc-9201-2da18f977199 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:10.962270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1269/2524] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:10.963091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:10.978499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef869-466e-4845-b983-63bf0337b696 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:10.984500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:10.985451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:10.985737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:10.986024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] PATH_INFO: `/v3/projects/452e2e8d2c804e459b1fff23ca217e5e/users/1be342abb8f94988be880ecf62a158af/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:10.988109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452e2e8d2c804e459b1fff23ca217e5e, user_id=1be342abb8f94988be880ecf62a158af, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:10.990775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:11.006247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1256/2525] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:10 2022] PUT /identity/v3/projects/452e2e8d2c804e459b1fff23ca217e5e/users/1be342abb8f94988be880ecf62a158af/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:11.017334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:11.017730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:11.018105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:11.049120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] MFA Rules not processed for user `1be342abb8f94988be880ecf62a158af`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:11.050543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:11.108519 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:11.142225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1270/2526] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:11.154453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:11.157038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:11.228725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47746d-c3ad-4377-b582-715aab98a223 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:11.233667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:11.234459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:11.234908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:11.235229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:11.314499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:11.316157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87057b-1c71-4eb5-8ebd-136e2863c878 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:11.326758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1257/2527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:14.366410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:14.380482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc63ab-4c46-43bf-8d0c-8a8a31653364 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:14.384409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:14.385350 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:14.385507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:14.386009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:14.397324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:14.399454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:14.423452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1271/2528] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:15.245828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7333e-3587-40d8-848e-c9d08136e638 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:15.246300 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7333e-3587-40d8-848e-c9d08136e638 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:15.246386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7333e-3587-40d8-848e-c9d08136e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:15.294494 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:15.309319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-20c7333e-3587-40d8-848e-c9d08136e638 None None] MFA Rules not processed for user `8a8f5596627144cfb640b7a7fb96de51`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:15.310621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-20c7333e-3587-40d8-848e-c9d08136e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:15.395016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1258/2529] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:15.413751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:15.415493 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:15.518741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1502ac-1e21-4f2a-b010-e5a4d4527cd2 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:15.524830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:15.525629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:15.525931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:15.526214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:15.528763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:15.605711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:15.607381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:15.622464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1272/2530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:16.752262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa066b-7404-469a-91c4-8d3795dd0450 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:16.752770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa066b-7404-469a-91c4-8d3795dd0450 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:16.752892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa066b-7404-469a-91c4-8d3795dd0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:16.771842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-27fa066b-7404-469a-91c4-8d3795dd0450 None None] MFA Rules not processed for user `139816304d534626b03e45afa6517530`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:16.773196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-27fa066b-7404-469a-91c4-8d3795dd0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:16.780940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1259/2531] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:25.617340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=73 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:26.766364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=33 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:27.210557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:27.274824 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f799c-621d-47c5-a443-d80bac06f4e5 service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:27.279584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:27.281058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:27.281347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:27.281624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] PATH_INFO: `/v3/users/ae13a306035844f9976015a1e7922ad7` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:27.282883 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae13a306035844f9976015a1e7922ad7)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:27.284857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:27.330840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae13a306035844f9976015a1e7922ad7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.337548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae13a306035844f9976015a1e7922ad7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.338224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae13a306035844f9976015a1e7922ad7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.346341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae13a306035844f9976015a1e7922ad7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.347029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae13a306035844f9976015a1e7922ad7'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.365401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1273/2532] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:27 2022] DELETE /identity/v3/users/ae13a306035844f9976015a1e7922ad7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:27.369994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:27.370310 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:27.370729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:27.388766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:27.390517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:27.453568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1260/2533] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:27.463413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:27.464863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:27.523467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59395-306a-4057-baf3-19c1da295fde admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:27.527893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:27.529056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:27.529056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:27.529314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:27.538891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:27.540357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:27.549783 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1274/2534] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:27.836908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:27.838484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:27.852012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b13b-6eb8-4047-b901-fa2be416c6a1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:27.857545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:27.859192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:27.859665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:27.859885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] PATH_INFO: `/v3/projects/a503a67b9a984d98bd8fac4764373699` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:27.861414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a503a67b9a984d98bd8fac4764373699)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:27.863446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:27.926605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a503a67b9a984d98bd8fac4764373699', 'request_id': 'req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.932238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a503a67b9a984d98bd8fac4764373699', 'request_id': 'req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.942541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a503a67b9a984d98bd8fac4764373699', 'request_id': 'req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.955123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] The token cache is being invalidate because project a503a67b9a984d98bd8fac4764373699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:27.955512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.956249 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:27.958920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1261/2535] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:27 2022] DELETE /identity/v3/projects/a503a67b9a984d98bd8fac4764373699 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:27.962150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:27.971841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9ac5-2b51-4980-b0eb-9c5d6b61a404 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:27.993768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:28.042150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.043646 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.044131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.044420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] PATH_INFO: `/v3/users/1be342abb8f94988be880ecf62a158af` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.046273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be342abb8f94988be880ecf62a158af)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.048251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.102701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be342abb8f94988be880ecf62a158af'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.113687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be342abb8f94988be880ecf62a158af'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.114502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be342abb8f94988be880ecf62a158af'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.125767 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be342abb8f94988be880ecf62a158af'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.126399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a65d13d6-7929-42ed-954f-2f5087be9e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be342abb8f94988be880ecf62a158af'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.145551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1275/2536] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:27 2022] DELETE /identity/v3/users/1be342abb8f94988be880ecf62a158af => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:28.424400 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.426223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:28.443725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27d22-3cf7-4dc3-a4de-e6dd53253282 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.506122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.506982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.507264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.507538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] PATH_INFO: `/v3/projects/452e2e8d2c804e459b1fff23ca217e5e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.508736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=452e2e8d2c804e459b1fff23ca217e5e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.510646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.543067 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:28.562393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452e2e8d2c804e459b1fff23ca217e5e', 'request_id': 'req-75844a56-80df-4709-b606-2c1518c1af67'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.567998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452e2e8d2c804e459b1fff23ca217e5e', 'request_id': 'req-75844a56-80df-4709-b606-2c1518c1af67'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.575667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452e2e8d2c804e459b1fff23ca217e5e', 'request_id': 'req-75844a56-80df-4709-b606-2c1518c1af67'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.587419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] The token cache is being invalidate because project 452e2e8d2c804e459b1fff23ca217e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:28.587710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.588371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-75844a56-80df-4709-b606-2c1518c1af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:28.589924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1262/2537] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:28 2022] DELETE /identity/v3/projects/452e2e8d2c804e459b1fff23ca217e5e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:28.595372 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.595759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.595940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.614023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:28.615256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:28.674239 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1276/2538] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:28.682153 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.682443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.682726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.701045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:28.702755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:28.710697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1263/2539] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:28.714757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.724973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bc294-7164-4366-9b1b-fce86b1c808a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.729635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.730303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.730594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.730876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.731663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:28.732008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.733659 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.745256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1277/2540] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:17:28.749334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.758546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f513827-a081-4ac3-8e62-803c0b6ae5e9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.763244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.763928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.764244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.765020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.765731 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.768116 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.795887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1264/2541] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:28 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:28.800108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.810265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12e23-781a-40bb-a977-2485d27e6a39 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.837761 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:28.871404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.872104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.872389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.872690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.873356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.875796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.895873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1278/2542] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:28 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:17:28.899737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.910199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57e9a-21eb-427c-aba1-df3b98ba08f2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.915059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.915817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.916211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.916826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.917573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.919288 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.929836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1265/2543] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:28.933753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.944325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631af46-d26f-4f2b-a900-e316e87b2f84 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.948885 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.949538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.950079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.950361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.951081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:28.953273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26cca6-c994-43b4-9fe3-8ef992820c90 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:28.962943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1279/2544] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:28.966807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:28.976728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c455a-52b8-47a7-938e-4e9a7d12106e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:28.981366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:28.982283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:28.982652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:28.982942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] PATH_INFO: `/v3/projects/d123f20c715b401786bb3b15c4f78975/users/295d8ca0e10f46288081a20fa21be7d9/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:28.997293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d123f20c715b401786bb3b15c4f78975, user_id=295d8ca0e10f46288081a20fa21be7d9, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.000532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.013973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1266/2545] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:28 2022] PUT /identity/v3/projects/d123f20c715b401786bb3b15c4f78975/users/295d8ca0e10f46288081a20fa21be7d9/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:29.025331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.025627 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.025907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.051694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] MFA Rules not processed for user `295d8ca0e10f46288081a20fa21be7d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:29.052932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:29.118302 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1280/2546] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:29.122811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.184958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4c20-a023-4fe0-b8a3-83a4afd84c4f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.190359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.191013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.191296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.191572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.192293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.194491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.219786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1267/2547] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:29 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:29.223845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.234748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859e7c7-2938-4f48-93b4-b072c1de1023 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.292665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.293343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.293633 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.293917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.294631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.297195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.318422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1281/2548] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:29 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:29.322257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.333135 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e6975-d752-41dd-a459-a9e8b3079add admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.337747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.338412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.338817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.339106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.339840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.341464 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.355162 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1268/2549] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:29.356600 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.367045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646303-a708-47b9-a1c8-379f84c0a046 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.371651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.372559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.372843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.373145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] PATH_INFO: `/v3/projects/95140da82ed24152b29c1052465bf734/users/a2f34356c19f4fecad99c6e7952cf655/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.388843 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=95140da82ed24152b29c1052465bf734, user_id=a2f34356c19f4fecad99c6e7952cf655, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.391751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.413965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1282/2550] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:29 2022] PUT /identity/v3/projects/95140da82ed24152b29c1052465bf734/users/a2f34356c19f4fecad99c6e7952cf655/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:29.417866 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.428406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5682bf-e4b9-4774-8408-5e301c666f20 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.450758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:29.491570 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.492290 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.492579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.492857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.493591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.495190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f4eeb-444a-4bad-8759-15577c9bcfe7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.506304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1269/2551] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:29.511185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.517331 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:29.523554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6b001-8cbd-42bc-829e-5f48615ed0de admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.528499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.529374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.529660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.529948 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] PATH_INFO: `/v3/projects/95140da82ed24152b29c1052465bf734/users/a2f34356c19f4fecad99c6e7952cf655/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.532610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95140da82ed24152b29c1052465bf734, user_id=a2f34356c19f4fecad99c6e7952cf655, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.535246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.545344 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1283/2552] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:29 2022] PUT /identity/v3/projects/95140da82ed24152b29c1052465bf734/users/a2f34356c19f4fecad99c6e7952cf655/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:29.555596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.555893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.556212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.582879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] MFA Rules not processed for user `a2f34356c19f4fecad99c6e7952cf655`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:29.584129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:29.657261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1270/2553] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:29.667973 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.669867 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:29.729931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a89ff-a0ab-4dd6-94b5-8515c065b4e7 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.734766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.735414 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.735700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.735999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.745092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.746501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6b94f-627b-4466-8fbb-78a408eaf86c service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:29.756423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1284/2554] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:29.883303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:29.948709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2a7e-8729-43a0-8af9-b9c681df77a1 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:29.954710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:29.955584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:29.955874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:29.956188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] PATH_INFO: `/v3/users/295d8ca0e10f46288081a20fa21be7d9` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:29.957536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295d8ca0e10f46288081a20fa21be7d9)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:29.959472 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:30.007391 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295d8ca0e10f46288081a20fa21be7d9'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.008092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295d8ca0e10f46288081a20fa21be7d9'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.009331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:30.017743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295d8ca0e10f46288081a20fa21be7d9'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.026554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295d8ca0e10f46288081a20fa21be7d9'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.027168 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295d8ca0e10f46288081a20fa21be7d9'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.046028 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1271/2555] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:29 2022] DELETE /identity/v3/users/295d8ca0e10f46288081a20fa21be7d9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:30.050730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:30.051024 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:30.051300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:30.071160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:30.072383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:30.132574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1285/2556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:17:30.142661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:30.144092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:30.201721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051634-1bb7-43eb-8fe5-fc9bf94465d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:30.205905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:30.206545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:30.206832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:30.207111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:30.216035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:30.217509 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:30.227488 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1272/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:30.502850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:30.504740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:30.531088 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44461c2-e8e8-4fcb-9def-f34cc8ceb3ad None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:30.536811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:30.537752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:30.538112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:30.538452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] PATH_INFO: `/v3/projects/d123f20c715b401786bb3b15c4f78975` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:30.539881 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d123f20c715b401786bb3b15c4f78975)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:30.542906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:30.592684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd123f20c715b401786bb3b15c4f78975', 'request_id': 'req-a4f6677d-0800-4f16-85da-051bce0e816c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.600182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd123f20c715b401786bb3b15c4f78975', 'request_id': 'req-a4f6677d-0800-4f16-85da-051bce0e816c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.605838 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd123f20c715b401786bb3b15c4f78975', 'request_id': 'req-a4f6677d-0800-4f16-85da-051bce0e816c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.616759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] The token cache is being invalidate because project d123f20c715b401786bb3b15c4f78975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:30.617047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.617680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.619214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1286/2558] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:30 2022] DELETE /identity/v3/projects/d123f20c715b401786bb3b15c4f78975 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:30.623309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:30.633395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c01a9-1afa-4b82-a26c-ca933d98a3bb service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:30.688156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:30.689003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:30.689284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:30.689559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] PATH_INFO: `/v3/users/a2f34356c19f4fecad99c6e7952cf655` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:30.690726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f34356c19f4fecad99c6e7952cf655)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:30.693050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:30.739164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f34356c19f4fecad99c6e7952cf655'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.739821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f34356c19f4fecad99c6e7952cf655'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.746718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f34356c19f4fecad99c6e7952cf655'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.754323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f34356c19f4fecad99c6e7952cf655'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.755029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-c4a989bb-2f4a-44e6-80b3-df67022e89c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f34356c19f4fecad99c6e7952cf655'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:30.760262 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:30.774613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1273/2559] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:30 2022] DELETE /identity/v3/users/a2f34356c19f4fecad99c6e7952cf655 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:31.281312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.282731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:31.295782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6677d-0800-4f16-85da-051bce0e816c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.307711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:31.354839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.355696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.356008 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.356289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] PATH_INFO: `/v3/projects/95140da82ed24152b29c1052465bf734` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.357462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=95140da82ed24152b29c1052465bf734)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.359341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.407328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95140da82ed24152b29c1052465bf734', 'request_id': 'req-25b978b8-29ec-4cd3-b800-42de35a4e7ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:31.414816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95140da82ed24152b29c1052465bf734', 'request_id': 'req-25b978b8-29ec-4cd3-b800-42de35a4e7ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:31.420401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95140da82ed24152b29c1052465bf734', 'request_id': 'req-25b978b8-29ec-4cd3-b800-42de35a4e7ad'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:31.432625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] The token cache is being invalidate because project 95140da82ed24152b29c1052465bf734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:31.433015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:31.433700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-25b978b8-29ec-4cd3-b800-42de35a4e7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:31.435308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1287/2560] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:31 2022] DELETE /identity/v3/projects/95140da82ed24152b29c1052465bf734 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:31.440997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.441469 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.441587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.459687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:31.460955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:31.519502 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1274/2561] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:31.528555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.528845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.529126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.547498 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:31.548652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:31.556864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1288/2562] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:31.560937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.570525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4749c-5bd9-433e-b0a4-047dd4525643 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.575306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.575943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.576253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.576528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.577771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:31.578078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.579681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.591902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1275/2563] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:17:31.596665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.611272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2743dd-530c-4a76-9bdd-d4a055ed10be None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.615993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.616647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.616935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.617214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.617921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.619801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.650141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1289/2564] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:31.651601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.662393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9a912-0cc4-43b3-90e1-22961a4f2215 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.724577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.725265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.725604 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.725894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.726640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.728622 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.749113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1276/2565] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:31.753254 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.763411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5991d-3dfc-4e9f-bd3a-ef998ef2a105 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.768490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.769136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.769418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.769720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.770450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.772062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.782674 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1290/2566] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:31.786340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.796362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175909d-0fc1-4c4f-9006-28aeabc766ce admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.801022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.801620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.801905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.802186 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.802911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.804525 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5b980-5c12-451b-aa22-534611679b48 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.814253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1277/2567] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:31.818241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:31.829129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae272f0-20ba-45af-a6e6-dd271715d7e6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:31.833715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:31.834580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.834863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.835135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] PATH_INFO: `/v3/projects/e231be11ba43467cbf3fdcba00107eb1/users/a93050eb5f44446abb56aae742b23d93/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.849873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e231be11ba43467cbf3fdcba00107eb1, user_id=a93050eb5f44446abb56aae742b23d93, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:31.852525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:31.864908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1291/2568] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:31 2022] PUT /identity/v3/projects/e231be11ba43467cbf3fdcba00107eb1/users/a93050eb5f44446abb56aae742b23d93/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:17:31.875125 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:31.875452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:31.875737 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:31.902324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] MFA Rules not processed for user `a93050eb5f44446abb56aae742b23d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:31.903549 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:31.946105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:31.973013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1278/2569] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:31.977491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.020932 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:32.043763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ee57-ba88-4c42-89d1-1e8f2b6b3ad9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.048967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.049597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.049882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.050161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.050891 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.052870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.079051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1292/2570] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:31 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:32.083016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.094123 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f878c8d-803e-4961-9698-588f8cc6cf2c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.149906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.150575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.150865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.151149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.151883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.153840 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.176134 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1279/2571] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:32 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:32.180014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.190697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4415-e188-4e24-b11f-ac68c440c2b6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.195181 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.195829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.196162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.196443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.197169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.198735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.209275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1293/2572] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:32.213254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.223852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedae9-01c0-47f8-b030-85391798b085 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.228630 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.229527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.229818 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.230102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] PATH_INFO: `/v3/projects/354afbe54cae41f19b768019c8f9c4df/users/057732b84402409498c5bf69f3fd0209/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.245446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354afbe54cae41f19b768019c8f9c4df, user_id=057732b84402409498c5bf69f3fd0209, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.248103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.260544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1280/2573] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:32 2022] PUT /identity/v3/projects/354afbe54cae41f19b768019c8f9c4df/users/057732b84402409498c5bf69f3fd0209/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:32.264989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.274993 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb575b-e311-4ae6-93db-cb5778d87637 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.330423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.331051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.331279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.331558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.332314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.333893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b8f84-b5bd-4bba-ba71-9b388ef10125 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.344057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1294/2574] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:32.348340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.358491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40464-6303-4c5e-b7a8-582a068190c2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.363110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.364019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.364305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.364580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] PATH_INFO: `/v3/projects/354afbe54cae41f19b768019c8f9c4df/users/057732b84402409498c5bf69f3fd0209/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.366574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354afbe54cae41f19b768019c8f9c4df, user_id=057732b84402409498c5bf69f3fd0209, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.369265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.379324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1281/2575] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:32 2022] PUT /identity/v3/projects/354afbe54cae41f19b768019c8f9c4df/users/057732b84402409498c5bf69f3fd0209/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:32.389180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.390003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.390290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.416753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] MFA Rules not processed for user `057732b84402409498c5bf69f3fd0209`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:32.417965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:32.489448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1295/2576] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:32.500081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:32.501872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:32.559442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f62b1a-7835-4063-9d1f-42b6c19da163 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:32.563149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:32.563814 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:32.564166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:32.564453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:32.615887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:32.626661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:32.628133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:32.637033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1282/2577] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:37.541220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:37.542760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:37.586755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:37.604496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7893d9b-d237-46c1-bea0-8ba312810f03 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:37.608115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:37.608768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:37.609553 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:37.609833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:37.611841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:37.622023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:37.623457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:37.632047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1296/2578] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:37.868780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:37.878161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501fbf-6536-4e29-8b16-6f81e4196c64 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:37.881735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:37.882369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:37.882652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:37.882929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:37.891910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:37.893342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716f0c-f61e-4c88-b649-5effb184f3c5 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:37.902972 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1283/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:42.872592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:42.941324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070c05d-25ba-4118-8dbb-330a653ad05d service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:42.946000 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:42.946909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:42.947195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:42.947476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] PATH_INFO: `/v3/users/a93050eb5f44446abb56aae742b23d93` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:42.948710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93050eb5f44446abb56aae742b23d93)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:42.950884 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:42.997583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93050eb5f44446abb56aae742b23d93'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.005312 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93050eb5f44446abb56aae742b23d93'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.005996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93050eb5f44446abb56aae742b23d93'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.013274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93050eb5f44446abb56aae742b23d93'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.013991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93050eb5f44446abb56aae742b23d93'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.032417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1297/2580] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:42 2022] DELETE /identity/v3/users/a93050eb5f44446abb56aae742b23d93 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:43.036867 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:43.037333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:43.037560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:43.055206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:43.056429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:43.115092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1284/2581] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:43.125328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:43.126773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:43.185127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782dec2-b61a-4483-90e6-dc2fed0c98dc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:43.188803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:43.189447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:43.189738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:43.190018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:43.199012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:43.200744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:43.210413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1298/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:43.472749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:43.474218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:43.487543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be88ee-6a44-4adf-b5ea-1ac2d0ece636 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:43.492443 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:43.493385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:43.493611 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:43.493865 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] PATH_INFO: `/v3/projects/e231be11ba43467cbf3fdcba00107eb1` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:43.495120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e231be11ba43467cbf3fdcba00107eb1)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:43.497167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:43.552430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e231be11ba43467cbf3fdcba00107eb1', 'request_id': 'req-bc807621-4722-40c3-9352-3771818d96a0'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.558545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e231be11ba43467cbf3fdcba00107eb1', 'request_id': 'req-bc807621-4722-40c3-9352-3771818d96a0'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.566885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e231be11ba43467cbf3fdcba00107eb1', 'request_id': 'req-bc807621-4722-40c3-9352-3771818d96a0'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.578846 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] The token cache is being invalidate because project e231be11ba43467cbf3fdcba00107eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:43.579141 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.579793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.581384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1285/2583] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:43 2022] DELETE /identity/v3/projects/e231be11ba43467cbf3fdcba00107eb1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:43.585422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:43.592474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:43.596746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff406a1-eb26-4c57-86e0-25821c2778f5 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:43.655512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:43.657035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:43.657322 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:43.657601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] PATH_INFO: `/v3/users/057732b84402409498c5bf69f3fd0209` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:43.658786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] RBAC: Authorizing `identity:delete_user(user_id=057732b84402409498c5bf69f3fd0209)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:43.660729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:43.709499 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057732b84402409498c5bf69f3fd0209'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.716170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057732b84402409498c5bf69f3fd0209'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.716830 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057732b84402409498c5bf69f3fd0209'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.724438 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057732b84402409498c5bf69f3fd0209'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.725162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-571c33b0-c676-4e07-b862-9824c86a976c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057732b84402409498c5bf69f3fd0209'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:43.742300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1299/2584] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:43 2022] DELETE /identity/v3/users/057732b84402409498c5bf69f3fd0209 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:44.004964 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.006437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:44.020808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc807621-4722-40c3-9352-3771818d96a0 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.079828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.080747 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.081051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.081373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] PATH_INFO: `/v3/projects/354afbe54cae41f19b768019c8f9c4df` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.082607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354afbe54cae41f19b768019c8f9c4df)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.084781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.086907 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:44.136610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354afbe54cae41f19b768019c8f9c4df', 'request_id': 'req-826d2506-35c3-43c9-b90a-47cf8474f537'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:44.146492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354afbe54cae41f19b768019c8f9c4df', 'request_id': 'req-826d2506-35c3-43c9-b90a-47cf8474f537'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:44.156230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354afbe54cae41f19b768019c8f9c4df', 'request_id': 'req-826d2506-35c3-43c9-b90a-47cf8474f537'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:44.168368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] The token cache is being invalidate because project 354afbe54cae41f19b768019c8f9c4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:44.168662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:44.169319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-826d2506-35c3-43c9-b90a-47cf8474f537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:44.171314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1286/2585] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:44 2022] DELETE /identity/v3/projects/354afbe54cae41f19b768019c8f9c4df => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:44.176972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.177450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.177548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.198749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:44.200295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:44.259820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1300/2586] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:44.268113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.268406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.268694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.286376 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:44.287565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:44.295341 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1287/2587] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:44.299942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.309524 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7413b-0c19-4de9-bed5-172b5a16adf9 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.314876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.315562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.315849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.316161 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.316931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:17:44.317242 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.318831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.330465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1301/2588] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:17:44.334692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.344013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bb8e-c36c-433a-abbb-1f6668853b64 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.348741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.349385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.349671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.349949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.350645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.352576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.379251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1288/2589] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:17:44 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:44.383282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.393204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66717e-f80e-468b-b681-f48009ff8db1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.397811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:44.453960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.454621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.454909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.455187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.455882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.458036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.477381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1302/2590] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:17:44 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:17:44.481751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.492572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d369-fa63-4604-956e-5842c9528ca2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.497261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.497908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.498196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.498477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.499644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.501947 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.512677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1289/2591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:44.516721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.527079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931613f-44ef-454c-b9ed-f313194d1b27 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.531779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.532467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.532752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.533028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.533752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.535325 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885e8bc-f43e-4b77-bfb9-4fa347373d48 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.545834 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1303/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:17:44.550697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.560769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf25-9838-4678-8b53-7e8759b701ff admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.566013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.566893 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.567178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.567453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] PATH_INFO: `/v3/projects/f01b1af10086408e8aed65ae4a31fd8a/users/18167866678240fe8471491ab86d4472/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.581948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01b1af10086408e8aed65ae4a31fd8a, user_id=18167866678240fe8471491ab86d4472, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.584629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.599181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1290/2593] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:17:44 2022] PUT /identity/v3/projects/f01b1af10086408e8aed65ae4a31fd8a/users/18167866678240fe8471491ab86d4472/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:44.610815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2884f4-6c08-49c1-b488-8e65eced3e78 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.611103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2884f4-6c08-49c1-b488-8e65eced3e78 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.611380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2884f4-6c08-49c1-b488-8e65eced3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.638831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8e2884f4-6c08-49c1-b488-8e65eced3e78 None None] MFA Rules not processed for user `18167866678240fe8471491ab86d4472`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:44.640064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8e2884f4-6c08-49c1-b488-8e65eced3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:44.704182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1304/2594] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:17:44.715197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:44.717005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:44.775044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5e77-269f-46e6-8993-a4ac0143c665 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:44.778815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:44.779461 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:44.779744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:44.780050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:44.789150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:44.790579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:44.800385 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1291/2595] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:47.792300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:47.792762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:47.792873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:47.811437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:47.812848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:47.870620 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1305/2596] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:17:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:17:47.883326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:47.884763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:47.918063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:47.956569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236034f3-9e01-47a8-8505-835a35b6b7c1 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:47.961452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:47.962094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:47.962378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:47.962683 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:47.971108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:47.972738 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:47.980623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1292/2597] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:17:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:17:51.560955 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:51.563787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:51.596131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:51.638682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdb756-d892-4902-b49a-7e2c7338fe1f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:51.643359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:51.644057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:51.647291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:51.647291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:51.647291 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:51.723272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:51.724951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a026e03-8f8d-4057-887d-1632d2eff942 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:51.736812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1306/2598] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:17:55.071890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:55.139206 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3e4f-b074-405e-a5b1-d1f61816fa34 service swift] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:55.145618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:55.146524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:55.146820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:55.147103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] PATH_INFO: `/v3/users/18167866678240fe8471491ab86d4472` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:55.148356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18167866678240fe8471491ab86d4472)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:55.150336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:55.214889 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18167866678240fe8471491ab86d4472'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.215637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18167866678240fe8471491ab86d4472'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.225808 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18167866678240fe8471491ab86d4472'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.235925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18167866678240fe8471491ab86d4472'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.236786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18167866678240fe8471491ab86d4472'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.260675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1293/2599] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:17:55 2022] DELETE /identity/v3/users/18167866678240fe8471491ab86d4472 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:17:55.265268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:55.266370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:55.266667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:55.289317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:17:55.290638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:55.364014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1307/2600] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:17:55.373068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:55.374709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:55.419068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:55.439586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db75b-08f8-440d-9a58-a3269e85c728 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:55.444545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:55.445393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:55.445862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:55.446182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:55.462121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:55.463705 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b336-ffd1-47b4-ab9b-8709e04f88c0 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:55.476140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1294/2601] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:17:55.872209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:17:55.875582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:17:55.896054 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df916d-3e66-4c84-9db1-5d5ba05ecfea None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:17:55.907876 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:17:55.908812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:17:55.909073 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:17:55.909389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] PATH_INFO: `/v3/projects/f01b1af10086408e8aed65ae4a31fd8a` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:17:55.912554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01b1af10086408e8aed65ae4a31fd8a)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:17:55.914773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:17:55.967832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01b1af10086408e8aed65ae4a31fd8a', 'request_id': 'req-9f9b9994-db59-4a75-88fd-ca74e273abbb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.976367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01b1af10086408e8aed65ae4a31fd8a', 'request_id': 'req-9f9b9994-db59-4a75-88fd-ca74e273abbb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.982746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01b1af10086408e8aed65ae4a31fd8a', 'request_id': 'req-9f9b9994-db59-4a75-88fd-ca74e273abbb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.985478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:17:55.996595 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] The token cache is being invalidate because project f01b1af10086408e8aed65ae4a31fd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:17:55.997117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:55.999887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:17:56.002210 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1308/2602] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:17:55 2022] DELETE /identity/v3/projects/f01b1af10086408e8aed65ae4a31fd8a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:18:05.473467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:06.003750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:06.549422 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b171a-6b0a-4e5c-a48e-9795328c14a5 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:06.549904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b171a-6b0a-4e5c-a48e-9795328c14a5 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:06.549999 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b171a-6b0a-4e5c-a48e-9795328c14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:06.567446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7b2b171a-6b0a-4e5c-a48e-9795328c14a5 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:18:06.568667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7b2b171a-6b0a-4e5c-a48e-9795328c14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:06.623696 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1295/2603] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:18:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:18:06.635355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:06.636784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:06.705233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9994-db59-4a75-88fd-ca74e273abbb admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:06.710212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:06.710849 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:06.711137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:06.711418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:06.720037 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:06.721613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:06.729664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1309/2604] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:18:16.616946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=25 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:16.726376 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=32 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:27.054420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f576c-7455-4428-90da-31925b7559cd None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:27.054894 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f576c-7455-4428-90da-31925b7559cd None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:27.054991 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f576c-7455-4428-90da-31925b7559cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:27.074234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-479f576c-7455-4428-90da-31925b7559cd None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:18:27.075697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-479f576c-7455-4428-90da-31925b7559cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:27.082973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1296/2605] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:18:27.094893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:27.105464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991a8f-87d9-45b3-b984-3e88650c94bc service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:27.110814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:27.111462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:27.111745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:27.112602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:27.121167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:27.123062 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:27.133505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1310/2606] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:18:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:18:37.067970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:37.130432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=6 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:48.504003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f576c-7455-4428-90da-31925b7559cd None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:48.505457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-479f576c-7455-4428-90da-31925b7559cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:48.574454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f576c-7455-4428-90da-31925b7559cd None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:48.579905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:48.580587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:48.580878 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:48.581156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:48.583548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:48.600425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:48.602068 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:48.612781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1297/2607] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:18:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:18:53.416785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:53.418236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:53.476353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba202-3b41-45df-b0e3-dd2b14c1737f service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:53.479917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:53.480585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:53.480873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:53.481151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:53.482922 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:53.543622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:53.545076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:53.555282 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1311/2608] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:18:56.564049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:56.565516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:56.581483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76754d-6801-4031-b74f-f0c316a15d50 service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:56.592702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:56.593644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:56.593954 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:56.594239 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] PATH_INFO: `/v3/users/cc4f7b9f69ab47a39e1219a0605e7049` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:56.595468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4f7b9f69ab47a39e1219a0605e7049)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:56.597516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:56.649223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4f7b9f69ab47a39e1219a0605e7049'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.649879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4f7b9f69ab47a39e1219a0605e7049'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.657389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4f7b9f69ab47a39e1219a0605e7049'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.666157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4f7b9f69ab47a39e1219a0605e7049'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.666901 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-577b105e-fa7c-4a05-a2cc-5285467a0a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4f7b9f69ab47a39e1219a0605e7049'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.687079 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1298/2609] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:18:56 2022] DELETE /identity/v3/users/cc4f7b9f69ab47a39e1219a0605e7049 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:18:56.860365 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:56.870464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311440b-7ce2-4886-afc1-7493dd6e2d4d service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:56.927094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:56.927966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:56.928255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:56.928529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] PATH_INFO: `/v3/projects/db417a2b6b5c4bcd94d6bdb2b2b298cd` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:56.929695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db417a2b6b5c4bcd94d6bdb2b2b298cd)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:56.931567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:56.977231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db417a2b6b5c4bcd94d6bdb2b2b298cd', 'request_id': 'req-afb33566-f841-4f1c-9367-16ad5714eb03'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.979590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:56.984584 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db417a2b6b5c4bcd94d6bdb2b2b298cd', 'request_id': 'req-afb33566-f841-4f1c-9367-16ad5714eb03'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:56.991111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db417a2b6b5c4bcd94d6bdb2b2b298cd', 'request_id': 'req-afb33566-f841-4f1c-9367-16ad5714eb03'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:57.005486 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] The token cache is being invalidate because project db417a2b6b5c4bcd94d6bdb2b2b298cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:18:57.005780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:57.006702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-afb33566-f841-4f1c-9367-16ad5714eb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:18:57.009405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1312/2610] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:18:56 2022] DELETE /identity/v3/projects/db417a2b6b5c4bcd94d6bdb2b2b298cd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:18:57.014556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.014852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.015137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.033920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:18:57.035102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:57.094395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1299/2611] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:18:57.103003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.103234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.103543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.122044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:18:57.123255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:57.131412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1313/2612] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:18:57.135727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.140637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:18:57.147369 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf22ec6-452f-4db9-8bf5-a61fdf07914a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.154008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.154797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.155316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.155596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.156368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:18:57.156681 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.158265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.171419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1300/2613] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:18:57.175875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.185103 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cd69e-4c9c-49fe-a8cd-eb7b19ddc697 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.189802 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.190453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.190735 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.191011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.191715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.194170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.219936 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1314/2614] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:18:57 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:18:57.224087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.233945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7dc22a-de5b-4b95-b96b-74516fd08847 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.289596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.290260 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.290544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.290820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.291503 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.293432 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.311166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1301/2615] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:18:57 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:18:57.315162 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.325930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f2f0d-0525-449b-a6ed-a7b5cda155a1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.330497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.331144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.331431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.331722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.332487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.334730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.345134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1315/2616] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:18:57.348883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.360006 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0aa86-88e7-4dda-b964-88dbc7cb6399 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.366156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.366822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.367108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.367389 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.368459 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.370891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccaf0a-aee6-475b-b16a-fe6213eb468b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.381457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1302/2617] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:18:57.385931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.396622 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d800a5-cad8-412d-972f-03c10887226f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.401246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.402120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.402447 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.402724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] PATH_INFO: `/v3/projects/26fd678c7c034bdb9ab44b0e73f1a260/users/4470341da36e405e992977c08898f5fb/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.416959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fd678c7c034bdb9ab44b0e73f1a260, user_id=4470341da36e405e992977c08898f5fb, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.419592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.432097 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1316/2618] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:18:57 2022] PUT /identity/v3/projects/26fd678c7c034bdb9ab44b0e73f1a260/users/4470341da36e405e992977c08898f5fb/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:18:57.437450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d328-271d-44ef-9597-ca2b5de87986 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.437880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d328-271d-44ef-9597-ca2b5de87986 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.438207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22d328-271d-44ef-9597-ca2b5de87986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.457243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-5c22d328-271d-44ef-9597-ca2b5de87986 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:18:57.459140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5c22d328-271d-44ef-9597-ca2b5de87986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:57.521340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1303/2619] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:18:57.530718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:18:57.532502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:18:57.593771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5407ab8-a5cd-434f-932f-e7065fc94838 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:18:57.597476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:18:57.598124 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:18:57.598446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:18:57.598727 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:18:57.608225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:18:57.609650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:18:57.619575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1317/2620] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:01.581682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1614d-9487-4048-8c3d-c45b8449d534 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:01.582185 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1614d-9487-4048-8c3d-c45b8449d534 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:01.582311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1614d-9487-4048-8c3d-c45b8449d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:01.627689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-b9f1614d-9487-4048-8c3d-c45b8449d534 None None] MFA Rules not processed for user `4470341da36e405e992977c08898f5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:01.628978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-b9f1614d-9487-4048-8c3d-c45b8449d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:01.706201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:01.713445 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1304/2621] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:01.727560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:01.729177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:01.819423 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092eb8-7821-4ce8-8cb8-2cfb35777106 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:01.826983 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:01.827716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:01.828136 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:01.828477 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:01.837826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:01.839545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:01.849634 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1318/2622] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:03.112876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:03.113353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:03.113482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:03.132537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] MFA Rules not processed for user `4470341da36e405e992977c08898f5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:03.133766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:03.141094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1305/2623] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:11.844910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:13.126335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:31.998187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:31.999631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:32.011502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19b50-ba39-4866-b4e1-f78500d6274b service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:32.015059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:32.015689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:32.016066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:32.016354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:32.018036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:32.029943 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:32.031347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:32.041692 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1319/2624] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:35.101008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.102531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:35.117050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24f85e-9404-43d3-90a0-048d9f3a2a9f None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.121677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.122500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.122764 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.123057 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] PATH_INFO: `/v3/users/20a6d94b2d03465cb3e7619609084680` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.124275 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a6d94b2d03465cb3e7619609084680)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.126202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.174330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a6d94b2d03465cb3e7619609084680'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.174987 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a6d94b2d03465cb3e7619609084680'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.182060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a6d94b2d03465cb3e7619609084680'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.189625 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a6d94b2d03465cb3e7619609084680'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.190264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-54ab93cb-20a6-45ff-9baf-bd82f15fc5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a6d94b2d03465cb3e7619609084680'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.207431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1306/2625] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:19:35 2022] DELETE /identity/v3/users/20a6d94b2d03465cb3e7619609084680 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:35.381892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.393637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd00b8-cb8a-4c75-ac25-bf1a0ea0d3d2 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.450578 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.451696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.452021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.452303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] PATH_INFO: `/v3/projects/b9444918ee6e4df894784a29c5678f28` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.453507 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9444918ee6e4df894784a29c5678f28)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.455404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.501828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9444918ee6e4df894784a29c5678f28', 'request_id': 'req-4588c26a-07c2-446e-a276-a257375176ac'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.509780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9444918ee6e4df894784a29c5678f28', 'request_id': 'req-4588c26a-07c2-446e-a276-a257375176ac'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.515478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9444918ee6e4df894784a29c5678f28', 'request_id': 'req-4588c26a-07c2-446e-a276-a257375176ac'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.528511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] The token cache is being invalidate because project b9444918ee6e4df894784a29c5678f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:19:35.528803 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.529452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-4588c26a-07c2-446e-a276-a257375176ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:35.531032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1320/2626] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:19:35 2022] DELETE /identity/v3/projects/b9444918ee6e4df894784a29c5678f28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:35.536100 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.536403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.536693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.554483 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:35.555695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:35.626653 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1307/2627] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:35.634890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.635177 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.635480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.654496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:35.655715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:35.663887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1321/2628] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:35.667850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.677480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bda5f8-dca2-434c-931b-b6a20b823fe9 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.682074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.682717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.683003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.683282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.684050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:19:35.684371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.685957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.697923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1308/2629] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:19:35.702133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.711764 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede752-3434-41fc-adb7-b99745fb1aa6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.716464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.717095 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.717377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.717649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.718347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.720240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.747656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1322/2630] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:19:35 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:19:35.749914 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.759748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7515-d487-4650-8993-3739bff066cc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.814649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.815312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.815600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.815884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.816616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.818540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.825094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:35.842547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1309/2631] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:19:35 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:35.844853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.855742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea556-5391-436c-afd6-dac0b754a269 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.860450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.861098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.861388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.861671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.862405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.864018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.874195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1323/2632] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:19:35.878078 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.887824 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7b06-a179-4d5c-99f8-b358ff4610f1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.892608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.893271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.893606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.893884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.894618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.896238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c1b19-f4a9-479d-9699-f23e7ea179ff admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.906587 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1310/2633] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:35.910489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:35.920869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f41f-eef8-419f-801c-d2d8336f98ba admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:35.925474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:35.926346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.926637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.926917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] PATH_INFO: `/v3/projects/e6f63637550543469b73c119f34ec094/users/29766449710545f19c2e49eb9c165788/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.941113 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f63637550543469b73c119f34ec094, user_id=29766449710545f19c2e49eb9c165788, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:35.943788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:35.956011 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1324/2634] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:35 2022] PUT /identity/v3/projects/e6f63637550543469b73c119f34ec094/users/29766449710545f19c2e49eb9c165788/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:19:35.967150 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:35.967442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:35.967831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:35.993903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] MFA Rules not processed for user `29766449710545f19c2e49eb9c165788`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:35.995107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:36.057401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1311/2635] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:36.067583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:36.069279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:36.083398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:36.127666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163cc3-dc11-4fdc-b817-801899cd7280 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:36.132001 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:36.132574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:36.132861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:36.133142 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:36.141402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:36.142827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aecb66-6e17-4761-ab54-984c59b487fb service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:36.152135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1325/2636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:44.356408 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:44.417225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e320684-f5a4-467c-b180-2c5a021bb3c8 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:44.421736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:44.422605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:44.422885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:44.423161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] PATH_INFO: `/v3/users/29766449710545f19c2e49eb9c165788` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:44.424364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29766449710545f19c2e49eb9c165788)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:44.426308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:44.472836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29766449710545f19c2e49eb9c165788'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:44.473484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29766449710545f19c2e49eb9c165788'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:44.480257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29766449710545f19c2e49eb9c165788'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:44.487471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29766449710545f19c2e49eb9c165788'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:44.488109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29766449710545f19c2e49eb9c165788'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:44.493197 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:44.507372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1312/2637] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:19:44 2022] DELETE /identity/v3/users/29766449710545f19c2e49eb9c165788 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:44.511860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:44.512353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:44.512476 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:44.530017 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:44.531222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:44.589747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1326/2638] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:44.599294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:44.600785 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:44.657401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda36e85-f654-4ce7-af4d-6d0351ebbda4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:44.661082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:44.661724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:44.662010 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:44.662291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:44.671170 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:44.672639 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a749ccb-cc0d-40bd-b2fd-aaafe9200dfc service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:44.681994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1313/2639] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:44.948431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:44.949887 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:44.963127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42448d-0fef-4b60-b76c-78b3b2f1af24 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:44.967961 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:44.969278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:44.969278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:44.969521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] PATH_INFO: `/v3/projects/e6f63637550543469b73c119f34ec094` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:44.970679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f63637550543469b73c119f34ec094)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:44.972647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.019572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f63637550543469b73c119f34ec094', 'request_id': 'req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:45.025965 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f63637550543469b73c119f34ec094', 'request_id': 'req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:45.031747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f63637550543469b73c119f34ec094', 'request_id': 'req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:45.043127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] The token cache is being invalidate because project e6f63637550543469b73c119f34ec094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:19:45.043415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:45.044141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-cc1bdc45-ca25-4b9e-9c9c-cbbccbd88901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:45.045731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1327/2640] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:19:44 2022] DELETE /identity/v3/projects/e6f63637550543469b73c119f34ec094 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:45.050796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.051074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.051353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.071734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:45.072973 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:45.129997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1314/2641] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:45.138397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.138690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.138967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.158060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:45.159273 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:45.167793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1328/2642] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:45.172110 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.182545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395073d-c59c-4da5-b1ef-5a464a1a90a6 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.187261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.187905 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.188219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.188497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.189225 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:19:45.189537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.191113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.202811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1315/2643] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:19:45.207092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.216637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42026f5e-7c70-4ed4-a89f-35fec9872c5e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.221258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.221882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.222168 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.222443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.223164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.225629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.251085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1329/2644] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:19:45.254750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.264606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c1886-d198-4f01-8b68-4f833d929b4f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.318794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.319447 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.319732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.320035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.320751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.322646 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.342130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1316/2645] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:19:45.346174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.356909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ae75-40b0-49b4-a739-76383c72b1b1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.361520 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.362180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.362471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.362753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.363488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.365116 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.371012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:45.379643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1330/2646] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:45.380965 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.392098 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede08170-c447-4c94-aae1-d6156f63bfd9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.397668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.398330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.398613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.398887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.399617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.401241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04220cf-3f1f-4119-8537-d8749deaf6de admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.402591 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:45.413470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1317/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:45.417311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.427083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bd8d9-6909-45d2-8d45-d57a7810009d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.432235 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.433105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.433391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.433696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] PATH_INFO: `/v3/projects/1112702684ec459db02439ad934bfcc9/users/b17facc15525456d95cb29563f0f361e/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.449449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1112702684ec459db02439ad934bfcc9, user_id=b17facc15525456d95cb29563f0f361e, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.452421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.465439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1331/2648] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:45 2022] PUT /identity/v3/projects/1112702684ec459db02439ad934bfcc9/users/b17facc15525456d95cb29563f0f361e/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:45.477133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.477427 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.477707 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.503297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] MFA Rules not processed for user `b17facc15525456d95cb29563f0f361e`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:45.504544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:45.568507 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1318/2649] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:45.573561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.636233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d719ff-42fe-434b-a681-a6ececb1073b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.640853 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.641504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.641789 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.642066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.642748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.644672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.670025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1332/2650] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:45.674062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.685517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3a4a-9878-48b2-b9cb-9c152ada3b32 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.739902 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.741093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.741373 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.741643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.742334 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.744253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.763446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1319/2651] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:45.767421 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.777740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e79b9-7a49-4144-95d5-aa753627209a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.782334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.782991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.783280 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.783562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.784355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.785951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.796298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1333/2652] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:45.800209 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.810645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136efa64-d284-4acd-96a2-52af1eb2cb1d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.815207 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.816113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.816396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.816673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] PATH_INFO: `/v3/projects/62001ee613f64053825732bafc8dc1c2/users/43212ddb06ca4ee0b9e7a8e157f01ff1/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.831978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62001ee613f64053825732bafc8dc1c2, user_id=43212ddb06ca4ee0b9e7a8e157f01ff1, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.834870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.848516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1320/2653] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:45 2022] PUT /identity/v3/projects/62001ee613f64053825732bafc8dc1c2/users/43212ddb06ca4ee0b9e7a8e157f01ff1/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:45.852373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.862377 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e628c-5e94-43eb-a504-6893022ea1e8 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.918027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.918616 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.918897 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.919179 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.919896 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.921496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55183f-72aa-4c0d-8510-e22b0734b2b0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.931613 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1334/2654] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:45.935770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:45.945951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a11a-732e-4af3-929e-670cdfcc7965 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:45.950454 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:45.951595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.951874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.952183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] PATH_INFO: `/v3/projects/62001ee613f64053825732bafc8dc1c2/users/43212ddb06ca4ee0b9e7a8e157f01ff1/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:45.954133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=62001ee613f64053825732bafc8dc1c2, user_id=43212ddb06ca4ee0b9e7a8e157f01ff1, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:45.956798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:45.966714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1321/2655] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:45 2022] PUT /identity/v3/projects/62001ee613f64053825732bafc8dc1c2/users/43212ddb06ca4ee0b9e7a8e157f01ff1/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:45.977485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:45.977782 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:45.978070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:46.009419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] MFA Rules not processed for user `43212ddb06ca4ee0b9e7a8e157f01ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:46.010730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:46.043736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:46.079317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1335/2656] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:46.090530 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:46.092296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:46.135025 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:46.150872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711755-9305-40a1-a06e-136c7def7ecf admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:46.154595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:46.155235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:46.155552 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:46.155833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:46.165331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:46.166790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:46.176243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1322/2657] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:46.246650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:46.256158 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87af7-d6d1-4028-9f56-0d611083d902 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:46.260004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:46.260652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:46.260942 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:46.261225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:46.317549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:46.319012 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe4be0-848a-4133-b16b-b6e5a9dba981 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:46.328105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1336/2658] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:53.216934 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:53.279631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b79f-d0a5-46ac-8e40-c84f524dcb75 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:53.284224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:53.285099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:53.285386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:53.285667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] PATH_INFO: `/v3/users/b17facc15525456d95cb29563f0f361e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:53.286848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17facc15525456d95cb29563f0f361e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:53.289359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:53.335634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17facc15525456d95cb29563f0f361e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.336245 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17facc15525456d95cb29563f0f361e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.343136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17facc15525456d95cb29563f0f361e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.351115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17facc15525456d95cb29563f0f361e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.351750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17facc15525456d95cb29563f0f361e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.369193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1323/2659] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:19:53 2022] DELETE /identity/v3/users/b17facc15525456d95cb29563f0f361e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:53.373718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:53.374194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:53.374379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:53.395731 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:53.397629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:53.455904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1337/2660] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:53.466231 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:53.467661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:53.524760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4d7e-3415-42b0-91e9-dcc457caa3d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:53.528420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:53.529064 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:53.529350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:53.529631 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:53.538567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:53.540009 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:53.549305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1324/2661] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:53.812835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:53.818186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:53.831070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc547a9-71db-4bf2-9d3a-b90fa571f382 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:53.835837 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:53.836746 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:53.837036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:53.837320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] PATH_INFO: `/v3/projects/1112702684ec459db02439ad934bfcc9` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:53.838529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1112702684ec459db02439ad934bfcc9)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:53.840619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:53.887378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1112702684ec459db02439ad934bfcc9', 'request_id': 'req-0eed4518-5576-4f9a-91e4-ecf3911bbffd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.894057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1112702684ec459db02439ad934bfcc9', 'request_id': 'req-0eed4518-5576-4f9a-91e4-ecf3911bbffd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.899875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1112702684ec459db02439ad934bfcc9', 'request_id': 'req-0eed4518-5576-4f9a-91e4-ecf3911bbffd'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.900959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:53.913025 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] The token cache is being invalidate because project 1112702684ec459db02439ad934bfcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:19:53.913317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.913956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:53.915492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1338/2662] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:19:53 2022] DELETE /identity/v3/projects/1112702684ec459db02439ad934bfcc9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:53.919638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:53.924501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:53.931182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87401-c539-41ad-931c-26a94c201260 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:53.986418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:53.987279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:53.987561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:53.987836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] PATH_INFO: `/v3/users/43212ddb06ca4ee0b9e7a8e157f01ff1` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:53.989049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43212ddb06ca4ee0b9e7a8e157f01ff1)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:53.991471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.034716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43212ddb06ca4ee0b9e7a8e157f01ff1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.035350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43212ddb06ca4ee0b9e7a8e157f01ff1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.042088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43212ddb06ca4ee0b9e7a8e157f01ff1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.048969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43212ddb06ca4ee0b9e7a8e157f01ff1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.049550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-30309e20-3841-4314-8918-4d06cb5fea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43212ddb06ca4ee0b9e7a8e157f01ff1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.066913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1325/2663] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:19:53 2022] DELETE /identity/v3/users/43212ddb06ca4ee0b9e7a8e157f01ff1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:54.330038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.332234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:54.345211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed4518-5576-4f9a-91e4-ecf3911bbffd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.404549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.405405 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.405688 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.405964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] PATH_INFO: `/v3/projects/62001ee613f64053825732bafc8dc1c2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.407134 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62001ee613f64053825732bafc8dc1c2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.409117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.454324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62001ee613f64053825732bafc8dc1c2', 'request_id': 'req-8d1a6760-2be2-4df0-9172-045e0eda5232'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.460921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62001ee613f64053825732bafc8dc1c2', 'request_id': 'req-8d1a6760-2be2-4df0-9172-045e0eda5232'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.466470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62001ee613f64053825732bafc8dc1c2', 'request_id': 'req-8d1a6760-2be2-4df0-9172-045e0eda5232'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.477934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] The token cache is being invalidate because project 62001ee613f64053825732bafc8dc1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:19:54.478227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.478870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-8d1a6760-2be2-4df0-9172-045e0eda5232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:54.480454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1339/2664] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:19:54 2022] DELETE /identity/v3/projects/62001ee613f64053825732bafc8dc1c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:54.485311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.485793 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.485897 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.504253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:54.505478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:54.562834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1326/2665] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:54.570505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.570797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.571079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.589852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:54.591060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:54.599013 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1340/2666] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:54.603719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.613606 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5a159-ef52-4d8f-808c-d03de3e13989 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.618715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.619378 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.619661 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.619933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.620733 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:19:54.621047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.623602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.635845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1327/2667] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:19:54.639921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.649494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164145-a40b-4a61-9993-e57377b7e053 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.654079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.654722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.655007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.655288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.656015 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.657907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.684059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1341/2668] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:19:54 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:54.687882 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.697864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9bb30-0222-45c5-bd06-5b0d51641d59 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.702718 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:54.755513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.756201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.756489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.756769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.757475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.759419 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.779046 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1328/2669] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:19:54 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:54.783118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.793833 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a6e3-b1b3-4eaf-b775-08752e668f80 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.798449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.799102 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.799390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.799675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.800446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.802032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.812283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1342/2670] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:54.816187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.826499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8924c-ad12-452e-91d8-d06cbf004f3e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.831313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.832038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.832286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.832565 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.833303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.835438 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01107630-6a23-4488-b4d8-c822536f54bf admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.845669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1329/2671] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:54.849549 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:54.859296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff57a53-64d2-4335-8958-838b06a38f58 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:54.863847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:54.864808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.865093 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.865882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] PATH_INFO: `/v3/projects/919a9be264f24095bc3491aa745ebc0d/users/b2c856bad74b4c078ae03e4d1920178d/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.881630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919a9be264f24095bc3491aa745ebc0d, user_id=b2c856bad74b4c078ae03e4d1920178d, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:54.884278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:54.897490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1343/2672] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:54 2022] PUT /identity/v3/projects/919a9be264f24095bc3491aa745ebc0d/users/b2c856bad74b4c078ae03e4d1920178d/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:19:54.908580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:54.908869 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:54.909148 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:54.937841 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] MFA Rules not processed for user `b2c856bad74b4c078ae03e4d1920178d`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:54.938971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:55.002269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1330/2673] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:55.006679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.027315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:55.069189 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc7d0-1903-40cd-aa29-b2f732619ee0 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.073862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.074517 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.074807 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.075090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.076084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.077970 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.102899 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1344/2674] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:19:55 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:55.106936 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.118091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b481e-a26d-4bbd-a882-07666bd759e2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.179697 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.180393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.180682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.180959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.181657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.183600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.203232 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1331/2675] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:19:55 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:19:55.207238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.217787 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9628ee-076c-4bd8-b325-a572a46957ec admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.222513 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.223176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.223466 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.223749 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.224521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.226618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.237229 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1345/2676] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:55.241851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.251784 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6effcf-4572-4c73-b911-552c1ba2b614 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.256478 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.257351 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.257641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.257924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] PATH_INFO: `/v3/projects/d2d18b8c2f2b49419822ff97e792780c/users/acbfbc947ddb4d878cbc170ef991e6f5/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.260190 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:55.274621 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d18b8c2f2b49419822ff97e792780c, user_id=acbfbc947ddb4d878cbc170ef991e6f5, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.277326 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.290384 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1332/2677] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:55 2022] PUT /identity/v3/projects/d2d18b8c2f2b49419822ff97e792780c/users/acbfbc947ddb4d878cbc170ef991e6f5/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:19:55.294503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.305362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06134e4-406a-494e-bf43-9a47516614bd admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.359845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.360544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.360815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.361091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.361808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.363374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad90f-3a21-4da6-b438-0c635dc33c54 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.373454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1346/2678] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:19:55.377788 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.390678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851bcb1-24c1-488f-af60-06fe169276eb admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.395771 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.396702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.396992 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.397276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] PATH_INFO: `/v3/projects/d2d18b8c2f2b49419822ff97e792780c/users/acbfbc947ddb4d878cbc170ef991e6f5/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.399246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d18b8c2f2b49419822ff97e792780c, user_id=acbfbc947ddb4d878cbc170ef991e6f5, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.401921 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.412481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1333/2679] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:19:55 2022] PUT /identity/v3/projects/d2d18b8c2f2b49419822ff97e792780c/users/acbfbc947ddb4d878cbc170ef991e6f5/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:55.422572 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.423020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.423135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.452063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] MFA Rules not processed for user `acbfbc947ddb4d878cbc170ef991e6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:55.453319 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:55.519314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1347/2680] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:19:55.529812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.531583 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:55.589418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc10b3-5890-4a15-a9e6-eccef8228cdd admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.593130 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.593773 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.594061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.594340 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.603657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.605119 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.614659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1334/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:55.686163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:55.695698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be475496-00c9-4ec9-a338-fc5dfcc251f5 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:55.699305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:55.699935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:55.700255 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:55.700534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:55.712706 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:55.759108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:55.760566 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890c34-a5ca-41ad-a919-49afb39e2ef0 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:55.769950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1348/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:19:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:19:59.760541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:19:59.821985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52de16d-962d-4f78-925a-54bad71a9003 service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:19:59.826787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:19:59.827650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:59.827940 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:59.828250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] PATH_INFO: `/v3/users/b2c856bad74b4c078ae03e4d1920178d` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:59.829467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c856bad74b4c078ae03e4d1920178d)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:19:59.831392 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:19:59.876350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c856bad74b4c078ae03e4d1920178d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:59.877003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c856bad74b4c078ae03e4d1920178d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:59.884033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c856bad74b4c078ae03e4d1920178d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:59.891063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c856bad74b4c078ae03e4d1920178d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:59.891734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c856bad74b4c078ae03e4d1920178d'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:19:59.899971 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:19:59.911528 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1335/2683] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:19:59 2022] DELETE /identity/v3/users/b2c856bad74b4c078ae03e4d1920178d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:19:59.916685 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:19:59.917166 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:19:59.917272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:19:59.933809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:19:59.935021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:19:59.995857 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1349/2684] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:00.005435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:00.006942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:00.063789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde944-aa9f-4e63-ba00-f13c7f341e10 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:00.067465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:00.068142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:00.068431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:00.068713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:00.077880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:00.079294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:00.089194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1336/2685] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:00.356019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:00.357654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:00.369814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d54e77-76b9-4269-a541-94a7d7d07c67 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:00.374326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:00.375196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:00.375480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:00.375754 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] PATH_INFO: `/v3/projects/919a9be264f24095bc3491aa745ebc0d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:00.376977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919a9be264f24095bc3491aa745ebc0d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:00.378957 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:00.425592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919a9be264f24095bc3491aa745ebc0d', 'request_id': 'req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.433501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919a9be264f24095bc3491aa745ebc0d', 'request_id': 'req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.439112 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919a9be264f24095bc3491aa745ebc0d', 'request_id': 'req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.451412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] The token cache is being invalidate because project 919a9be264f24095bc3491aa745ebc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:20:00.451710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.452369 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.453940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1350/2686] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:20:00 2022] DELETE /identity/v3/projects/919a9be264f24095bc3491aa745ebc0d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:00.457946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:00.468080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d726e-e853-4d77-b962-99de476a500a service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:00.523306 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:00.524201 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:00.524490 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:00.524766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] PATH_INFO: `/v3/users/acbfbc947ddb4d878cbc170ef991e6f5` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:00.525948 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbfbc947ddb4d878cbc170ef991e6f5)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:00.527849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:00.573191 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbfbc947ddb4d878cbc170ef991e6f5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.573766 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbfbc947ddb4d878cbc170ef991e6f5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.580811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbfbc947ddb4d878cbc170ef991e6f5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.588065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbfbc947ddb4d878cbc170ef991e6f5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.588713 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-abd10bc4-5e87-4891-9078-9f617a0eacff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbfbc947ddb4d878cbc170ef991e6f5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:00.606132 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1337/2687] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:20:00 2022] DELETE /identity/v3/users/acbfbc947ddb4d878cbc170ef991e6f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:00.880982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:00.882525 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:00.897234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93d67-a6ab-4a36-812c-2ccac185f5a6 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:00.932009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:00.956612 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:00.957482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:00.957772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:00.958053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] PATH_INFO: `/v3/projects/d2d18b8c2f2b49419822ff97e792780c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:00.959237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d18b8c2f2b49419822ff97e792780c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:00.961203 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.007403 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d18b8c2f2b49419822ff97e792780c', 'request_id': 'req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:01.014509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d18b8c2f2b49419822ff97e792780c', 'request_id': 'req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:01.020057 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d18b8c2f2b49419822ff97e792780c', 'request_id': 'req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:01.030999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] The token cache is being invalidate because project d2d18b8c2f2b49419822ff97e792780c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:20:01.031292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:01.031923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-d4b92877-46c6-42c7-a4e0-3d4cba1a9e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:01.033487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1351/2688] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:20:00 2022] DELETE /identity/v3/projects/d2d18b8c2f2b49419822ff97e792780c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:20:01.038976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.039516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.039607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.057873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:01.059062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:01.067296 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:01.119586 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1338/2689] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:01.127290 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.127583 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.127869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.145694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:01.146894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:01.154871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1352/2690] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:01.159082 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.169304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a758-8dae-412a-8388-75dbd3a1b1ac None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.173883 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.174533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.174826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.175108 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.176033 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:20:01.176354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.177942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.190087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1339/2691] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:20:01.194271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.203758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98199674-e6ad-4d36-937f-f285c33473bb None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.208382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.209019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.209303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.209579 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.210271 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.212170 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.237977 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1353/2692] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:01.242689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.252871 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff33ae-b172-42a6-af2c-100c1b17dd2e admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.308539 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.309227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.309513 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.309817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.310506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.312446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.331563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1340/2693] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:20:01.336257 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.346418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4e52-e907-4840-ba8a-bfd1de41cc99 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.351638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.352334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.352621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.352900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.353629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.355211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.366518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1354/2694] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:01.370362 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.380045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c8bc-cf7f-402c-94d0-51ff9f3e8bd6 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.384620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.385264 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.385545 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.385822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.386553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.388159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89038e1f-d9f2-405a-aee0-348d291dd021 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.398532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1341/2695] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:01.403250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.414287 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceba65-5795-4f40-a904-c22014334de3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.418933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.419815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.420132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.420415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] PATH_INFO: `/v3/projects/fc17e8a35ad54214bb6379124e784944/users/122ca6951b084d85afe17243cc278f52/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.434732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc17e8a35ad54214bb6379124e784944, user_id=122ca6951b084d85afe17243cc278f52, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.437374 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.450768 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1355/2696] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:20:01 2022] PUT /identity/v3/projects/fc17e8a35ad54214bb6379124e784944/users/122ca6951b084d85afe17243cc278f52/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:20:01.462638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.462926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.463203 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.489536 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] MFA Rules not processed for user `122ca6951b084d85afe17243cc278f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:01.490728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:01.553332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1342/2697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:01.557929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.620046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f307bf-7841-454b-80bc-4b2ff3c7be92 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.624863 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.625464 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.625753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.626028 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.626730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.628650 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.637250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:01.655686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1356/2698] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:01.659790 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.670313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550c3bd-cc53-4ebc-ad22-5a5ed5247b98 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.674885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:01.728717 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.729430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.729723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.730004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.730703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.732719 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.751665 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1343/2699] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:01.755510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.766216 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc83c3-3c14-4c8e-bb65-fdabff108410 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.770775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.771429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.771718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.772038 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.772771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.774980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.786324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1357/2700] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:01.790560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.800481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831335-3330-4105-856c-8e0d02bec92c admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.805089 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.805962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.806248 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.806540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] PATH_INFO: `/v3/projects/3c67254c8feb42809896d121c36ba97d/users/d4bc2b3e300b4799ad51ff13c154f567/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.821660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c67254c8feb42809896d121c36ba97d, user_id=d4bc2b3e300b4799ad51ff13c154f567, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.824354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.838103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1344/2701] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:20:01 2022] PUT /identity/v3/projects/3c67254c8feb42809896d121c36ba97d/users/d4bc2b3e300b4799ad51ff13c154f567/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:01.842245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.852164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd53d-8225-4121-8530-51d4520ff317 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.907801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.908418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.908708 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.908987 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.909719 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.911305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37083a0b-802f-42fe-84e0-05990e131160 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.920927 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1358/2702] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:20:01.925051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:01.935266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030654b6-f54c-4678-9892-3337be080ddc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:01.940016 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:01.940895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.941181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.941466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] PATH_INFO: `/v3/projects/3c67254c8feb42809896d121c36ba97d/users/d4bc2b3e300b4799ad51ff13c154f567/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.943476 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c67254c8feb42809896d121c36ba97d, user_id=d4bc2b3e300b4799ad51ff13c154f567, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:01.946677 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:01.957115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1345/2703] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:20:01 2022] PUT /identity/v3/projects/3c67254c8feb42809896d121c36ba97d/users/d4bc2b3e300b4799ad51ff13c154f567/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:01.967654 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:01.968137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:01.968251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:01.993862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] MFA Rules not processed for user `d4bc2b3e300b4799ad51ff13c154f567`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:01.995052 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:02.064800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1359/2704] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:02.075386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:02.077428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:02.134895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e3cf-e972-4d11-b4e5-ec9dbb63d472 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:02.138524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:02.139143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:02.139426 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:02.139701 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:02.149004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:02.150485 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:02.160060 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1346/2705] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:02.255195 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:02.265484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff356-00b8-4f3f-a989-58b5c3cf4892 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:02.269104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:02.269745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:02.270035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:02.270347 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:02.326320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:02.327739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972a1f-d42a-41ca-93cd-24ce87c10124 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:02.331340 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:02.338053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1360/2706] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:04.890309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:04.950548 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456911eb-ad8b-4a35-8f7e-3f48db591abd service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:04.955263 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:04.956143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:04.956425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:04.956698 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] PATH_INFO: `/v3/users/122ca6951b084d85afe17243cc278f52` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:04.957890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122ca6951b084d85afe17243cc278f52)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:04.959789 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:04.964308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:05.007243 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122ca6951b084d85afe17243cc278f52'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.007890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122ca6951b084d85afe17243cc278f52'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.014657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122ca6951b084d85afe17243cc278f52'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.021529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122ca6951b084d85afe17243cc278f52'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.022145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122ca6951b084d85afe17243cc278f52'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.039109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1347/2707] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:20:04 2022] DELETE /identity/v3/users/122ca6951b084d85afe17243cc278f52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:05.044099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:05.044585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:05.044717 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:05.062169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:05.063388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:05.119877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1361/2708] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:05.129308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:05.130799 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:05.188926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369e963-c553-4b13-98cd-89f463e97106 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:05.192652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:05.193289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:05.193571 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:05.193847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:05.203041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:05.204512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:05.213787 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1348/2709] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:05.480522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:05.481980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:05.494079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372c7b8-8c4c-421d-881c-196782be438e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:05.499781 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:05.500629 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:05.500921 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:05.501256 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] PATH_INFO: `/v3/projects/fc17e8a35ad54214bb6379124e784944` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:05.503338 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc17e8a35ad54214bb6379124e784944)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:05.505532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:05.553497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc17e8a35ad54214bb6379124e784944', 'request_id': 'req-1849a97c-d664-4b99-9b11-69c6b4676b81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.560649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc17e8a35ad54214bb6379124e784944', 'request_id': 'req-1849a97c-d664-4b99-9b11-69c6b4676b81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.566233 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc17e8a35ad54214bb6379124e784944', 'request_id': 'req-1849a97c-d664-4b99-9b11-69c6b4676b81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.577479 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] The token cache is being invalidate because project fc17e8a35ad54214bb6379124e784944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:20:05.577771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.578398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.579937 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1362/2710] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:20:05 2022] DELETE /identity/v3/projects/fc17e8a35ad54214bb6379124e784944 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:05.583868 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:05.594122 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e292bed-6c53-4292-b40e-62d723b52f77 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:05.650211 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:05.651005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:05.651293 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:05.651574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] PATH_INFO: `/v3/users/d4bc2b3e300b4799ad51ff13c154f567` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:05.652962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bc2b3e300b4799ad51ff13c154f567)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:05.654969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:05.683212 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:05.702084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bc2b3e300b4799ad51ff13c154f567'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.702742 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bc2b3e300b4799ad51ff13c154f567'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.709613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bc2b3e300b4799ad51ff13c154f567'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.717531 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bc2b3e300b4799ad51ff13c154f567'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.718155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d941420-6096-4ac8-afe2-9461c3afaa19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bc2b3e300b4799ad51ff13c154f567'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:05.735065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1349/2711] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:20:05 2022] DELETE /identity/v3/users/d4bc2b3e300b4799ad51ff13c154f567 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:06.011009 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.012563 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:06.026737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849a97c-d664-4b99-9b11-69c6b4676b81 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.084115 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.084989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.085275 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.085551 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] PATH_INFO: `/v3/projects/3c67254c8feb42809896d121c36ba97d` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.086744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c67254c8feb42809896d121c36ba97d)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.089230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.113104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:06.136805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c67254c8feb42809896d121c36ba97d', 'request_id': 'req-110d290a-51f8-4931-aaae-27d0f312cd14'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:06.144904 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c67254c8feb42809896d121c36ba97d', 'request_id': 'req-110d290a-51f8-4931-aaae-27d0f312cd14'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:06.150534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c67254c8feb42809896d121c36ba97d', 'request_id': 'req-110d290a-51f8-4931-aaae-27d0f312cd14'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:06.161652 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] The token cache is being invalidate because project 3c67254c8feb42809896d121c36ba97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:20:06.161947 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:06.162590 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-110d290a-51f8-4931-aaae-27d0f312cd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:06.164155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1363/2712] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:20:06 2022] DELETE /identity/v3/projects/3c67254c8feb42809896d121c36ba97d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:06.169137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.169584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.169694 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.188112 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:06.189271 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:06.247387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1350/2713] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:06.256387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.256684 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.256963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.276651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:06.277871 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:06.285705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1364/2714] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:06.289943 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.299874 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6076-2237-48cb-829b-f036ec2d4f4b None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.304466 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.305114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.305402 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.305682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.306959 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:20:06.307272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.308887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.320280 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1351/2715] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:20:06.324844 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.334068 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2483-782b-4fcb-b48f-bda48e7952fc None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.338666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.339305 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.339587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.339862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.340604 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.342467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.366738 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1365/2716] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:20:06 2022] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:06.371238 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.381167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628a779-3de8-4268-a39b-9430ab1854fd admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.436724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.437387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.437679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.437962 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.438727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.440595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.460982 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1352/2717] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:20:06 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:06.465154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.475267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8f7d-2d7a-4bbb-8862-bf7fe1df25ca admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.480480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.481132 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.481422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.481702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.482434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.484053 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.495034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1366/2718] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:06.498748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.508826 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79605f42-8ef9-4e5d-9aa6-b94c19564a67 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.513460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.514124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.514406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.514688 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.515416 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.517027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eae10-04b4-49a9-a6bc-912c1c657734 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.526811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1353/2719] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:06.530640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.540912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756267-456d-457a-b7d2-8048a5ce2057 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.545473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.546336 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.546619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.546893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] PATH_INFO: `/v3/projects/cfae5619223f4a44b8549284015cecf4/users/b9bc445967a94cef8ece9c4a5d7eb036/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.562382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfae5619223f4a44b8549284015cecf4, user_id=b9bc445967a94cef8ece9c4a5d7eb036, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.565058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.577574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1367/2720] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:20:06 2022] PUT /identity/v3/projects/cfae5619223f4a44b8549284015cecf4/users/b9bc445967a94cef8ece9c4a5d7eb036/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:06.587797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.588127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.588410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.607832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:06.616196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] MFA Rules not processed for user `b9bc445967a94cef8ece9c4a5d7eb036`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:06.618022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:06.681765 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1354/2721] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:06.693022 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:06.694681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:06.750866 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739532d-3b20-41f1-bfd9-a0a113f04a98 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:06.754492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:06.755125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:06.755413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:06.755694 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:06.763906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:06.765348 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875c9d-ed7c-43dd-a877-44b1e6116068 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:06.774084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1368/2722] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:16.678269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=27 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:16.770085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:20.138637 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:20.203039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93721d3c-8e51-48a8-bf05-d2d26d92d3fa None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:20.207582 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:20.208506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.208794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.209074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] PATH_INFO: `/v3/users/b9bc445967a94cef8ece9c4a5d7eb036` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.210265 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bc445967a94cef8ece9c4a5d7eb036)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:20.212215 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:20.256156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bc445967a94cef8ece9c4a5d7eb036'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.256888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bc445967a94cef8ece9c4a5d7eb036'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.264547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bc445967a94cef8ece9c4a5d7eb036'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.271732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bc445967a94cef8ece9c4a5d7eb036'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.272379 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bc445967a94cef8ece9c4a5d7eb036'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.290268 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1355/2723] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:20:20 2022] DELETE /identity/v3/users/b9bc445967a94cef8ece9c4a5d7eb036 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:20.294704 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.295222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.295332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.312915 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:20.314123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:20.371641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1369/2724] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:20:20.381522 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:20.383022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:20.439726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855571-dfe8-490c-9bd9-6df1f2d39177 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:20.443371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:20.444149 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.444569 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.444852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.454960 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:20.456467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bdabc-e279-41e6-be21-f4ed66674c5a service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:20.466164 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1356/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:20.723576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:20.725091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:20.740346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de6a8-2a15-4887-9497-0b6e3a5c0b09 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:20.746542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:20.747679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.748061 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.748439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] PATH_INFO: `/v3/projects/cfae5619223f4a44b8549284015cecf4` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.749856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfae5619223f4a44b8549284015cecf4)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:20.751741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:20.798380 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfae5619223f4a44b8549284015cecf4', 'request_id': 'req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.806972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfae5619223f4a44b8549284015cecf4', 'request_id': 'req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.812649 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfae5619223f4a44b8549284015cecf4', 'request_id': 'req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.823378 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] The token cache is being invalidate because project cfae5619223f4a44b8549284015cecf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:20:20.823669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.824311 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-87d9a75a-ada1-44cb-b75e-67ff6e5c51b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:20:20.825879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1370/2726] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:20:20 2022] DELETE /identity/v3/projects/cfae5619223f4a44b8549284015cecf4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:20.830925 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.831219 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.831504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.849118 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:20.850325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:20.867607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:20.910350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1357/2727] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:20.918545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.918839 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.919121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.937645 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:20.938831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:20.946653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1371/2728] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:20.950620 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:20.960511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27993bed-f961-4694-8608-9b1dfbcc2b91 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:20.965105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:20.965750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:20.966038 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:20.966320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:20.967054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:20:20.967370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:20.969012 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:20.981105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1358/2729] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:20:20.985122 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:20.995332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac71176-f6fd-483a-ad5a-41ee8159e107 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.000705 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.001475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.001760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.002035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.002751 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.004724 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.029337 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1372/2730] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:21.033451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:21.044023 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe182-2dd7-4599-b3f2-f9162d7ce158 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.100004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.100602 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.100891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.101171 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.101872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.104435 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.123431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1359/2731] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:20:21 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:20:21.127465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:21.137758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbda06-1ea7-4f7d-9753-f1a2eb02fcee admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.142327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.142982 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.143270 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.143550 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.144308 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.145890 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.156573 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1373/2732] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:21.160251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:21.170986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ad189-489f-4970-a632-b6838dfdcac9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.175640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.176325 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.176617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.176900 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.177640 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.179259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f502db-1429-477e-8f8c-e35d9006f05e admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.189042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1360/2733] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:20:21.192968 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:21.203081 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d94a6-37f7-40f1-9662-33c6e361be7c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.207975 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.208864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.209148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.209425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] PATH_INFO: `/v3/projects/0b82e51dcf8e424c9ca6805e32200fb0/users/1304d4c9735f4af79fba7a5de344f912/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.224679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b82e51dcf8e424c9ca6805e32200fb0, user_id=1304d4c9735f4af79fba7a5de344f912, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.227288 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.240777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1374/2734] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:20:21 2022] PUT /identity/v3/projects/0b82e51dcf8e424c9ca6805e32200fb0/users/1304d4c9735f4af79fba7a5de344f912/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:20:21.245873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b01b-55e0-4a77-ad03-a616158ebc63 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.246202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b01b-55e0-4a77-ad03-a616158ebc63 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.246486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b01b-55e0-4a77-ad03-a616158ebc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.264076 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-78b4b01b-55e0-4a77-ad03-a616158ebc63 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:21.265295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-78b4b01b-55e0-4a77-ad03-a616158ebc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:21.324095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1361/2735] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:21.334079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:21.335766 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:21.358108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:21.394389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092afc6c-75d8-46dd-878e-f4daf4a4b354 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:21.398026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:21.398660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:21.398950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:21.399224 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:21.409231 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:21.410651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:21.420449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1375/2736] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:22.011348 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179142d-6007-467f-bcbb-4c4bba937809 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:22.011635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179142d-6007-467f-bcbb-4c4bba937809 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:22.011913 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179142d-6007-467f-bcbb-4c4bba937809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:22.038095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f179142d-6007-467f-bcbb-4c4bba937809 None None] MFA Rules not processed for user `1304d4c9735f4af79fba7a5de344f912`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:22.039330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f179142d-6007-467f-bcbb-4c4bba937809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:22.060797 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:22.110354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1362/2737] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:22.122027 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:22.123457 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:22.181092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6977-fe2b-455e-b069-a78eb202c2ca service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:22.185411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:22.186035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:22.186320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:22.186597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:22.194999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:22.196449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:22.206046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1376/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:23.546031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:23.546546 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:23.546654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:23.564154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] MFA Rules not processed for user `1304d4c9735f4af79fba7a5de344f912`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:23.565359 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:23.572791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1363/2739] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:23.610963 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:23.612361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:23.680396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccd103-f4ca-4ca5-809c-e76dccf8c562 service cinder] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:23.684490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:23.685130 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:23.685417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:23.685693 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:23.687458 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:23.753778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=100 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:23.756451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:23.758406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bae1f4-d972-4da0-a567-5fafa6001f04 service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:23.769597 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1377/2740] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:24.276323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:24.286143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf21e3-f681-4585-9219-8d59e6c76c28 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:24.289762 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:24.290397 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:24.290716 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:24.290997 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:24.293284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:24.307133 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:24.308691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267c54-f2e1-432c-98da-2c7efeb59a42 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:24.319879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1364/2741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:33.764671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:34.314598 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=28 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:38.080671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99b1b-bedf-4497-8cb4-04be9211c7b3 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:38.081151 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99b1b-bedf-4497-8cb4-04be9211c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:38.081263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99b1b-bedf-4497-8cb4-04be9211c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:38.098036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-cdd99b1b-bedf-4497-8cb4-04be9211c7b3 None None] MFA Rules not processed for user `4470341da36e405e992977c08898f5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:38.099228 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-cdd99b1b-bedf-4497-8cb4-04be9211c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:38.152307 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1378/2742] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:40.274222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d3d-599b-4c3a-ab50-0df863519657 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:40.274744 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d3d-599b-4c3a-ab50-0df863519657 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:40.274852 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d3d-599b-4c3a-ab50-0df863519657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:40.300072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-13563d3d-599b-4c3a-ab50-0df863519657 None None] MFA Rules not processed for user `1304d4c9735f4af79fba7a5de344f912`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:40.301350 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-13563d3d-599b-4c3a-ab50-0df863519657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:40.312066 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1365/2743] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:20:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:48.145707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=25 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:50.294573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:20:51.440934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.441496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.441760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] PATH_INFO: `/` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.443546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1379/2744] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:20:51.452479 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019234f-ce6d-4370-8174-75784fbb7049 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.453054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019234f-ce6d-4370-8174-75784fbb7049 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.453054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019234f-ce6d-4370-8174-75784fbb7049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.505087 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-f019234f-ce6d-4370-8174-75784fbb7049 None None] MFA Rules not processed for user `13efde93abb94f78b4cf7b2df191136a`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:51.506998 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-f019234f-ce6d-4370-8174-75784fbb7049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:51.515648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1366/2745] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:20:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:20:51.535716 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:51.538450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:51.553029 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107f723-d495-4a63-a6b9-8175ec0cb706 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:51.556822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:51.557484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.557772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.558090 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.567186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:51.568991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff57b-4213-4c8e-aeef-2bfae76b9d4f service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:51.579264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1380/2746] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:51.667903 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c0c3-62bb-4b62-a1b2-30db0f0d278c None None] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.668333 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c0c3-62bb-4b62-a1b2-30db0f0d278c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.668618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c0c3-62bb-4b62-a1b2-30db0f0d278c None None] PATH_INFO: `/` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.670018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1367/2747] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 23 09:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 09:20:51.674988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.675281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.675560 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.693841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] MFA Rules not processed for user `b8fc0436447946d6b65f0ec3880a0c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:20:51.695046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:51.705150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1381/2748] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 23 09:20:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:20:51.716114 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4c0c3-62bb-4b62-a1b2-30db0f0d278c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:51.727143 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4c0c3-62bb-4b62-a1b2-30db0f0d278c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:51.730735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:51.731368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:51.731657 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:51.731937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:51.742018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:51.743446 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:51.754632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1368/2749] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:20:57.151484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:20:57.163292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354f2c8-ff8d-4885-8d29-2fd7a582e622 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:20:57.167689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:20:57.168469 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:20:57.168756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:20:57.169059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:20:57.170969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:20:57.181263 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:20:57.182710 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:20:57.191446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1382/2750] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:20:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:21:01.252045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:01.253636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:01.269690 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f28a7-1c8a-4149-8732-cc84359836ab service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:01.275761 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:01.276456 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:01.277460 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:01.277751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:01.279660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:01.292413 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:01.294313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59096e87-f5c1-4075-9569-5613cd0ce68e service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:01.305596 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1369/2751] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:21:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:21:03.515266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:03.517934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:03.536544 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec5f64-676f-408c-a419-8e868f6f1666 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:03.542496 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:03.543111 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:03.543394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:03.543784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:03.545743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:03.557725 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:03.559293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:03.570451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1383/2752] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:21:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 09:21:04.441147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3fab8-7f2c-47f0-99b9-2128f4de26b2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:04.441593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3fab8-7f2c-47f0-99b9-2128f4de26b2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:04.441743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3fab8-7f2c-47f0-99b9-2128f4de26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:04.461283 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-55c3fab8-7f2c-47f0-99b9-2128f4de26b2 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:04.462493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-55c3fab8-7f2c-47f0-99b9-2128f4de26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:04.525244 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1370/2753] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 23 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:04.573106 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:04.574518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:04.643800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a81b3-1b07-4716-8535-f4168d579dab service nova] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:04.648778 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:04.649422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:04.649712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:04.649999 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:04.658446 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:04.660066 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:04.668656 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1384/2754] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:21:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 09:21:14.518578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=46 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:14.664911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=53 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:20.008453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:20.008937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:20.009049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:20.026266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] MFA Rules not processed for user `baa89e3c59b641fe89fcc36f75ee396c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:20.027501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:20.034863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1371/2755] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 23 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:20.047188 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:20.057585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b0748-1338-46d0-9b87-3c9e9502772e service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:20.063165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5ec849ef0e431d8ad7e84c94fac8c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:20.063793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:20.064118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:20.064397 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:20.072244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:20.073829 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:20.082007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1385/2756] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 23 09:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 09:21:21.985845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:21.997923 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6f0f4-895a-432f-9ca6-eb4dbde34be2 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.002691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.003566 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.003851 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.004167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] PATH_INFO: `/v3/users/1304d4c9735f4af79fba7a5de344f912` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.005354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1304d4c9735f4af79fba7a5de344f912)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.007254 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.052629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1304d4c9735f4af79fba7a5de344f912'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.053274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1304d4c9735f4af79fba7a5de344f912'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.060074 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1304d4c9735f4af79fba7a5de344f912'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.067450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1304d4c9735f4af79fba7a5de344f912'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.068131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-db439121-affb-4b8a-8243-d2dc4cf1cb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1304d4c9735f4af79fba7a5de344f912'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.085237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1372/2757] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:21:21 2022] DELETE /identity/v3/users/1304d4c9735f4af79fba7a5de344f912 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:21:22.253964 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.265658 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5ac1-13c9-4f10-8d36-d780c4ca6f2e service swift] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.321762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.322619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.322908 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.323721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] PATH_INFO: `/v3/projects/0b82e51dcf8e424c9ca6805e32200fb0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.325045 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b82e51dcf8e424c9ca6805e32200fb0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.327240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.371277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b82e51dcf8e424c9ca6805e32200fb0', 'request_id': 'req-79b1a339-1d46-4e03-a6b1-50801b897574'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.378941 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b82e51dcf8e424c9ca6805e32200fb0', 'request_id': 'req-79b1a339-1d46-4e03-a6b1-50801b897574'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.384625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b82e51dcf8e424c9ca6805e32200fb0', 'request_id': 'req-79b1a339-1d46-4e03-a6b1-50801b897574'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.395822 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] The token cache is being invalidate because project 0b82e51dcf8e424c9ca6805e32200fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:21:22.396146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.396776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-79b1a339-1d46-4e03-a6b1-50801b897574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:22.398332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1386/2758] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:21:22 2022] DELETE /identity/v3/projects/0b82e51dcf8e424c9ca6805e32200fb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:21:22.403792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.404120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.404409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.421961 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:22.423236 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:22.481312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1373/2759] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:22.488660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.488953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.489237 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.507591 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:22.508814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:22.517272 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1387/2760] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:22.521282 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.531256 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca8c75-678c-46ad-8489-4eb62662ac53 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.535850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.536523 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.536809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.537085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.537820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:21:22.538136 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.539730 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.551386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1374/2761] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:21:22.555619 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.565326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49748b-1775-4e3f-9d2a-12c18c603a05 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.569931 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.570576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.570864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.571141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.571841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.574399 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.603984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1388/2762] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:21:22.605155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.615222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99200-9317-4ed7-a7dc-dd3eb4bf1562 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.663297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:22.673183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.673881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.674336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.674632 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.675486 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.677652 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.697367 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1375/2763] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:21:22 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:21:22.702293 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.712521 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d764-b0e5-4bd2-9682-e8304d9ce373 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.717192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.717848 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.718137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.718417 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.719149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.720775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.731129 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1389/2764] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:21:22.734805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.744579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12663-a7d8-44d8-b9f4-ad4c0f0862d8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.749888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.750543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.750835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.751120 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.751857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.753487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206cc05-b1ed-4484-a1e9-7b899e3a61bb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.763985 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1376/2765] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:21:22.767759 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.777643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c83a-8c72-44da-a229-2efc2ef3d373 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.782327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.783196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.783484 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.783762 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] PATH_INFO: `/v3/projects/235c3aeff17a42fca4366be06ac47c91/users/f79f136a11e7472da596fc6b1ac0536e/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.798120 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=235c3aeff17a42fca4366be06ac47c91, user_id=f79f136a11e7472da596fc6b1ac0536e, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:22.800784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:22.814079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1390/2766] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:21:22 2022] PUT /identity/v3/projects/235c3aeff17a42fca4366be06ac47c91/users/f79f136a11e7472da596fc6b1ac0536e/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:21:22.824555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.824839 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.825121 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:22.852529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] MFA Rules not processed for user `f79f136a11e7472da596fc6b1ac0536e`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:22.853728 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:22.916451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1377/2767] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:22.928182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:22.929950 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:22.944788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:22.988465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965138a-b0f0-4709-9bb7-5a1632f4e61b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:22.992104 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:22.992747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:22.993034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:22.993315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:23.002244 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:23.003671 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1724cd7-f0ba-4399-8ac5-0d4f6d8a1791 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:23.012926 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1391/2768] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:21:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:21:23.037578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:23.099176 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade13e6-fa18-4f8d-b223-b6494a3b278a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:23.103763 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:23.105167 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:23.105450 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:23.105729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] PATH_INFO: `/v3/users/f79f136a11e7472da596fc6b1ac0536e` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:23.106928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79f136a11e7472da596fc6b1ac0536e)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:23.108885 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:23.153615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79f136a11e7472da596fc6b1ac0536e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.154276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79f136a11e7472da596fc6b1ac0536e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.161065 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79f136a11e7472da596fc6b1ac0536e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.168706 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79f136a11e7472da596fc6b1ac0536e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.169339 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79f136a11e7472da596fc6b1ac0536e'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.170484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:23.190287 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1378/2769] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:21:23 2022] DELETE /identity/v3/users/f79f136a11e7472da596fc6b1ac0536e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:21:23.194962 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:23.195251 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:23.195529 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:23.212852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:21:23.214043 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:23.273827 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1392/2770] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:21:23.284018 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:23.285429 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:23.343235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb323-7a56-43bd-99aa-eb2cfb81cdc9 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:23.346922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:23.347561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:23.347849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:23.348154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:23.357649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:23.359331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:23.368848 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1379/2771] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:21:23.632747 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:21:23.634167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:21:23.647567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b94e-9f63-4739-87b1-8532473b8a2f None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:21:23.652812 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:21:23.653679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:21:23.654079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:21:23.654396 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] PATH_INFO: `/v3/projects/235c3aeff17a42fca4366be06ac47c91` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:21:23.655569 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235c3aeff17a42fca4366be06ac47c91)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:21:23.657630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:21:23.708248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235c3aeff17a42fca4366be06ac47c91', 'request_id': 'req-2246b656-0d82-4198-ba67-42a17c008129'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.715934 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235c3aeff17a42fca4366be06ac47c91', 'request_id': 'req-2246b656-0d82-4198-ba67-42a17c008129'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.721545 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235c3aeff17a42fca4366be06ac47c91', 'request_id': 'req-2246b656-0d82-4198-ba67-42a17c008129'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.732433 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] The token cache is being invalidate because project 235c3aeff17a42fca4366be06ac47c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:21:23.732723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.733352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-2246b656-0d82-4198-ba67-42a17c008129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:21:23.734889 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1393/2772] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:21:23 2022] DELETE /identity/v3/projects/235c3aeff17a42fca4366be06ac47c91 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:21:33.364755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=33,keystone:DELETE=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:21:33.729420 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:17.780831 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:17.783593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:17.887470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479794-4973-49c7-b268-bc6783fc28f6 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:17.976039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8fc0436447946d6b65f0ec3880a0c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:17.976844 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:17.977222 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:17.977600 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:17.980063 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:17.993740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:17.995576 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:18.020090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1380/2773] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:20.455718 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:20.456358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:20.456358 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:20.474192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] MFA Rules not processed for user `4470341da36e405e992977c08898f5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:22:20.475473 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:20.530565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1394/2774] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:22:20.833045 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:20.834527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:20.890237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8395c78-0439-4244-ac6b-02d4017c629d service nova] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:20.893768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:20.894411 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:20.894699 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:20.894976 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:20.896757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:20.906062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:20.908017 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:20.915922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1381/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:21.478888 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:21.480437 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:21.551512 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec630bc-fdfa-46c4-bb4b-55e12e628dd8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:21.556828 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:21.557361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:21.557673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:21.557879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:21.559690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:21.571144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:21.572777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:21.583542 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1395/2776] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:30.912353 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=88 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:31.579246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=57 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:22:48.500578 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:48.536792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667b709-7ee5-447f-995c-99aebc8b394c service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:48.540405 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:48.541035 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:48.541317 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:48.541593 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:48.543346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:48.623115 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:48.624610 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:48.634051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1382/2777] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:53.419664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:53.439490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0b993-ab0e-45f7-987d-28c9431b6270 service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:53.443390 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:53.444002 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:53.444294 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:53.444574 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:53.446388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:53.537880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:53.539321 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:53.558648 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1396/2778] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:56.554316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:56.567529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc25d-8ac1-4fd6-8781-0c5f3968f1e9 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:56.572970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:56.573881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:56.574234 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:56.575101 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:56.576560 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:56.589323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:56.590994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:56.608673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1383/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:59.691561 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:59.707790 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6fbac-8628-40b5-a2c9-c2aae6ee3555 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:59.713715 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:59.714480 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:59.714862 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:59.715236 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:59.717780 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:59.732406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:59.734439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:59.746997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1397/2780] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:22:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:22:59.758452 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:22:59.761497 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:22:59.776188 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4200ca-09ba-4a24-a496-303bab9ce969 service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:22:59.782131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:22:59.783242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:22:59.783527 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:22:59.783805 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] PATH_INFO: `/v3/users/139816304d534626b03e45afa6517530` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:22:59.785054 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139816304d534626b03e45afa6517530)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:22:59.787177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:22:59.835161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139816304d534626b03e45afa6517530'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:22:59.835828 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139816304d534626b03e45afa6517530'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:22:59.842782 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139816304d534626b03e45afa6517530'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:22:59.853007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139816304d534626b03e45afa6517530'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:22:59.853638 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139816304d534626b03e45afa6517530'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:22:59.870859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1384/2781] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:22:59 2022] DELETE /identity/v3/users/139816304d534626b03e45afa6517530 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:23:00.039713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:23:00.050212 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77781c70-22f6-46cd-96cc-5a6f34ea8e58 service placement] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:23:00.106207 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:23:00.107072 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:23:00.107356 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:23:00.107632 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] PATH_INFO: `/v3/projects/310d86656be5457490e48e2fa22ea537` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:23:00.108872 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310d86656be5457490e48e2fa22ea537)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:23:00.110799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:23:00.148410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:00.158186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310d86656be5457490e48e2fa22ea537', 'request_id': 'req-c739f8b1-7c6a-423c-a595-ce3249c10648'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.165502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310d86656be5457490e48e2fa22ea537', 'request_id': 'req-c739f8b1-7c6a-423c-a595-ce3249c10648'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.170988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310d86656be5457490e48e2fa22ea537', 'request_id': 'req-c739f8b1-7c6a-423c-a595-ce3249c10648'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.181989 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] The token cache is being invalidate because project 310d86656be5457490e48e2fa22ea537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:23:00.182274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.182919 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.184503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1398/2782] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:23:00 2022] DELETE /identity/v3/projects/310d86656be5457490e48e2fa22ea537 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:23:00.189019 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:23:00.190399 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:23:00.204361 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b4543-3758-42dc-87db-cb669d998ec4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:23:00.208853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:00.260812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:23:00.261672 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:23:00.261953 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:23:00.262227 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] PATH_INFO: `/v3/users/8a8f5596627144cfb640b7a7fb96de51` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:23:00.263401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8f5596627144cfb640b7a7fb96de51)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:23:00.265328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:23:00.308285 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8f5596627144cfb640b7a7fb96de51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.308918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8f5596627144cfb640b7a7fb96de51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.316151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8f5596627144cfb640b7a7fb96de51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.323036 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8f5596627144cfb640b7a7fb96de51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.323645 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8f5596627144cfb640b7a7fb96de51'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.340702 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1385/2783] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:23:00 2022] DELETE /identity/v3/users/8a8f5596627144cfb640b7a7fb96de51 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:23:00.512732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:23:00.514317 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:23:00.528879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f8b1-7c6a-423c-a595-ce3249c10648 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:23:00.587149 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:23:00.588044 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:23:00.588333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:23:00.588618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] PATH_INFO: `/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:23:00.589820 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab74e5c6e9bd41eb83bcdad8c5cb2054)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:23:00.591826 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:23:00.638602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab74e5c6e9bd41eb83bcdad8c5cb2054', 'request_id': 'req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.645722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab74e5c6e9bd41eb83bcdad8c5cb2054', 'request_id': 'req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.651327 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab74e5c6e9bd41eb83bcdad8c5cb2054', 'request_id': 'req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.662755 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] The token cache is being invalidate because project ab74e5c6e9bd41eb83bcdad8c5cb2054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:23:00.663042 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.663664 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ec2c93e9-6517-4155-91ca-c98c5e7e0d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:23:00.665448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1399/2784] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:23:00 2022] DELETE /identity/v3/projects/ab74e5c6e9bd41eb83bcdad8c5cb2054 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:23:10.337272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:10.659623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:23:56.565031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:23:56.566434 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:23:56.661055 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965baf36-804b-48e8-b1c3-7acb1e1161d4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:23:56.721928 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:23:56.722580 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:23:56.722872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:23:56.723157 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:23:56.724983 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:23:56.736920 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:23:56.738500 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:23:56.748633 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1386/2785] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:23:59.760032 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:23:59.760531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:23:59.760531 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:23:59.778535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] MFA Rules not processed for user `4470341da36e405e992977c08898f5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:23:59.779744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:23:59.834669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1400/2786] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:24:00.134508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:24:00.135990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:24:00.204204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b2bb-b9d4-415b-bccf-b97a8a514880 service placement] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:24:00.207723 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:24:00.208387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:24:00.208671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:24:00.208946 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:24:00.210687 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:24:00.219899 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:24:00.221335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:24:00.229159 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1387/2787] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:24:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:24:01.449260 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:24:01.450732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:24:01.463281 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494bce4-dd7a-4c63-81de-07bce544598e None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:24:01.467418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:24:01.468123 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:24:01.468427 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:24:01.468713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:24:01.471252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:24:01.483193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:24:01.484673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:24:01.495252 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1401/2788] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:24:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:24:10.225692 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=98 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:24:11.490736 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=31 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:24.599294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:24.610154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f77a51-fb2a-47d9-9fc3-f3bf79155013 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:24.613768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:24.614406 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:24.614695 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:24.615048 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:24.617415 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:24.707455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:24.708969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:24.730163 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1388/2789] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:29.400185 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:29.408880 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322de2b-579d-4387-8878-1618faad0865 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:29.413034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:29.413668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:29.413956 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:29.414234 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:29.416019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:29.481076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:29.482562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:29.492432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1402/2790] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:32.608233 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:32.609660 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:32.623825 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e415-88d4-4e3c-9e9f-768de2ac6ed9 service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:32.628514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:32.629401 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:32.629682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:32.629955 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] PATH_INFO: `/v3/users/4470341da36e405e992977c08898f5fb` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:32.631659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4470341da36e405e992977c08898f5fb)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:32.633618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:32.679669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4470341da36e405e992977c08898f5fb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:32.680344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4470341da36e405e992977c08898f5fb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:32.688332 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4470341da36e405e992977c08898f5fb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:32.696193 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4470341da36e405e992977c08898f5fb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:32.696820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-571f488b-d941-4f3b-b5f9-64997fae122b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4470341da36e405e992977c08898f5fb'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:32.714659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1389/2791] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:32 2022] DELETE /identity/v3/users/4470341da36e405e992977c08898f5fb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:32.883562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:32.893642 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d3e22-9902-45d5-91ba-127f432e970f service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:32.949860 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:32.950730 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:32.951020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:32.951301 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] PATH_INFO: `/v3/projects/26fd678c7c034bdb9ab44b0e73f1a260` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:32.952516 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fd678c7c034bdb9ab44b0e73f1a260)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:32.954689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:32.998729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fd678c7c034bdb9ab44b0e73f1a260', 'request_id': 'req-df83ac30-a625-4335-b1ff-4b59e708605f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:33.006346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fd678c7c034bdb9ab44b0e73f1a260', 'request_id': 'req-df83ac30-a625-4335-b1ff-4b59e708605f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:33.011864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fd678c7c034bdb9ab44b0e73f1a260', 'request_id': 'req-df83ac30-a625-4335-b1ff-4b59e708605f'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:33.023470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] The token cache is being invalidate because project 26fd678c7c034bdb9ab44b0e73f1a260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:33.023763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:33.024422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-df83ac30-a625-4335-b1ff-4b59e708605f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:33.025971 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1403/2792] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:32 2022] DELETE /identity/v3/projects/26fd678c7c034bdb9ab44b0e73f1a260 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:33.031099 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.031394 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.031783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.073743 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:33.091891 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:33.093128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:33.150366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1390/2793] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:33.158047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.158346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.158640 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.179815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:33.181047 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:33.188852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1404/2794] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:33.193537 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.203240 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9184a-3ee1-4aa5-bf2c-4359e049edc0 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.208155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.208803 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.209091 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.209371 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.210107 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:25:33.210421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.212044 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.223410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1391/2795] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:25:33.227442 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.236528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4e85b-c824-45e2-a5f1-cc5795bd6533 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.241748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.242388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.242682 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.242997 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.243689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.245631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.260063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:33.273835 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1405/2796] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:33 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:33.277829 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.287543 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612eb8d-033d-413a-8c3c-dcaf332a708d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.342863 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.343139 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.343541 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.343711 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.344453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.346440 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.366673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1392/2797] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:33 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:33.371204 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.382603 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40824e-3472-415a-b336-f366b67bbd02 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.387167 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.387855 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.388183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.388494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.389222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.390910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.401284 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1406/2798] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:33.404918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.415235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b5c9-5d4c-48e9-bf51-01fdbced4e98 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.419807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.420794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.421084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.421364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.422090 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.423667 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d754362-6dd5-410e-af17-792a49ebc4c4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.434131 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1393/2799] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:33.438988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.450400 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9e2d0-dad2-4e75-b77a-39a02481d91a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.455443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.456355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.456638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.456913 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] PATH_INFO: `/v3/projects/5adbe19beb76498cb58e09de0a0120dc/users/88dc4a86f6f547749afc73dedfd1704c/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.471744 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adbe19beb76498cb58e09de0a0120dc, user_id=88dc4a86f6f547749afc73dedfd1704c, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.474925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.487910 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1407/2800] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:33 2022] PUT /identity/v3/projects/5adbe19beb76498cb58e09de0a0120dc/users/88dc4a86f6f547749afc73dedfd1704c/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:33.493628 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d8fb-23e1-435e-a769-ffebef55c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.493918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d8fb-23e1-435e-a769-ffebef55c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.494199 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1d8fb-23e1-435e-a769-ffebef55c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.511806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-36a1d8fb-23e1-435e-a769-ffebef55c3a4 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:33.513049 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-36a1d8fb-23e1-435e-a769-ffebef55c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:33.571080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1394/2801] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:33.580944 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:33.582643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:33.638894 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704c019-d2db-4494-a96a-18880e9a94b5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:33.642406 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:33.643041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:33.643326 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:33.643635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:33.652582 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:33.654004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:33.663985 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1408/2802] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:34.264138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.264678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.264798 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.277876 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:34.293489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] MFA Rules not processed for user `88dc4a86f6f547749afc73dedfd1704c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:34.294769 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:34.360205 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1395/2803] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:34.364655 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.374279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf7a1-664b-4328-9e8a-1fe9f37e062b service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.378785 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.379429 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.379711 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.380014 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.380720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.383114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.409757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1409/2804] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:34 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:34.413768 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.424533 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbb5c4-84e2-4db7-a2f2-97e3f806cc73 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.481061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.481732 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.482021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.482298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.482994 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.484949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.505137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1396/2805] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:34 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:34.509651 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.520058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1765469-9039-4aa8-acdc-def4c0c83950 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.525144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.525797 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.526080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.526357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.527075 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.528723 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.539003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1410/2806] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:34.542884 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.552734 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48371ff5-f493-47a1-8ba0-dbc9ae8983f1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.559886 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.561291 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.561724 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.562014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] PATH_INFO: `/v3/projects/083da62e68754d2da10d32b702e5d2d0/users/f956d256d31b44cdb9501e11f52ee29a/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.580516 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083da62e68754d2da10d32b702e5d2d0, user_id=f956d256d31b44cdb9501e11f52ee29a, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.583166 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.597331 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1397/2807] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:34 2022] PUT /identity/v3/projects/083da62e68754d2da10d32b702e5d2d0/users/f956d256d31b44cdb9501e11f52ee29a/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:34.601250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.611109 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caac695-0854-4f2c-8734-c46de48cbe1a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.667541 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.668218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.668502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.668784 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.669532 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.671135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f12d4a-5a92-45ba-859c-73784389a254 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.680800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1411/2808] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:34.685030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:34.695050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924ed8-9adb-47a0-8bbb-61d8151522b1 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:34.699680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:34.700534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:34.700819 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:34.701092 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] PATH_INFO: `/v3/projects/083da62e68754d2da10d32b702e5d2d0/users/f956d256d31b44cdb9501e11f52ee29a/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:34.703024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083da62e68754d2da10d32b702e5d2d0, user_id=f956d256d31b44cdb9501e11f52ee29a, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:34.705937 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:34.716412 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1398/2809] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:34 2022] PUT /identity/v3/projects/083da62e68754d2da10d32b702e5d2d0/users/f956d256d31b44cdb9501e11f52ee29a/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:35.311743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:35.312069 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:35.312353 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:35.338939 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] MFA Rules not processed for user `f956d256d31b44cdb9501e11f52ee29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:35.340193 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:35.353020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:35.410925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1412/2810] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:36.669196 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:36.722061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:36.736517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0f7cb-61e7-42fd-ab57-32ff69a7fe33 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:36.741650 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:36.742524 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:36.742811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:36.743093 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] PATH_INFO: `/v3/users/88dc4a86f6f547749afc73dedfd1704c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:36.744312 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88dc4a86f6f547749afc73dedfd1704c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:36.746364 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:36.791313 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88dc4a86f6f547749afc73dedfd1704c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:36.792008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88dc4a86f6f547749afc73dedfd1704c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:36.799173 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88dc4a86f6f547749afc73dedfd1704c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:36.807085 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88dc4a86f6f547749afc73dedfd1704c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:36.807729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88dc4a86f6f547749afc73dedfd1704c'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:36.825279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1399/2811] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:36 2022] DELETE /identity/v3/users/88dc4a86f6f547749afc73dedfd1704c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:36.997051 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.008538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f57ff-9c26-42bc-8aac-cb4a2d049e32 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.067114 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.068094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.068383 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.068667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] PATH_INFO: `/v3/projects/5adbe19beb76498cb58e09de0a0120dc` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.070497 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adbe19beb76498cb58e09de0a0120dc)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.072434 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.118534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adbe19beb76498cb58e09de0a0120dc', 'request_id': 'req-412f872d-9e16-45f7-826e-cb7be367847c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.125387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adbe19beb76498cb58e09de0a0120dc', 'request_id': 'req-412f872d-9e16-45f7-826e-cb7be367847c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.130856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adbe19beb76498cb58e09de0a0120dc', 'request_id': 'req-412f872d-9e16-45f7-826e-cb7be367847c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.142019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] The token cache is being invalidate because project 5adbe19beb76498cb58e09de0a0120dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:37.142309 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.142928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.144489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1413/2812] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:36 2022] DELETE /identity/v3/projects/5adbe19beb76498cb58e09de0a0120dc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:37.148455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.149896 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:37.162712 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc78da-fe5c-40fb-89e0-bd40011a954d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.217833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.218703 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.218993 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.219276 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] PATH_INFO: `/v3/users/f956d256d31b44cdb9501e11f52ee29a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.220489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f956d256d31b44cdb9501e11f52ee29a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.222395 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.267005 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f956d256d31b44cdb9501e11f52ee29a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.267662 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f956d256d31b44cdb9501e11f52ee29a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.274675 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f956d256d31b44cdb9501e11f52ee29a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.281942 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f956d256d31b44cdb9501e11f52ee29a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.282561 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-3b99eef2-7afd-4a91-9e65-9b38e0aee510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f956d256d31b44cdb9501e11f52ee29a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.288314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:37.302229 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1400/2813] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:37 2022] DELETE /identity/v3/users/f956d256d31b44cdb9501e11f52ee29a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:37.470453 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.471845 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:37.485487 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f872d-9e16-45f7-826e-cb7be367847c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.527169 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:37.545241 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.546107 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.546398 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.546675 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] PATH_INFO: `/v3/projects/083da62e68754d2da10d32b702e5d2d0` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.547852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=083da62e68754d2da10d32b702e5d2d0)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.549775 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.595219 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083da62e68754d2da10d32b702e5d2d0', 'request_id': 'req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.605669 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083da62e68754d2da10d32b702e5d2d0', 'request_id': 'req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.611328 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083da62e68754d2da10d32b702e5d2d0', 'request_id': 'req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.622450 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] The token cache is being invalidate because project 083da62e68754d2da10d32b702e5d2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:37.622742 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.623373 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-ecc5bdbf-0183-453e-8e87-13aa6391dfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:37.624972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1414/2814] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:37 2022] DELETE /identity/v3/projects/083da62e68754d2da10d32b702e5d2d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:37.629963 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.630277 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.630563 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.649355 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:37.650420 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:37.709140 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1401/2815] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:37.717246 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac742a5-62a7-4891-8587-39d1770681db None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.717538 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac742a5-62a7-4891-8587-39d1770681db None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.717818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac742a5-62a7-4891-8587-39d1770681db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.736267 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-eac742a5-62a7-4891-8587-39d1770681db None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:37.737459 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-eac742a5-62a7-4891-8587-39d1770681db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:37.745266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1415/2816] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:37.749370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.759052 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553d40-9d2a-4ec8-aa68-2c6818bff80a None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.763615 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.764303 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.764592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.764872 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.765605 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:25:37.765918 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.767501 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.785635 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1402/2817] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:25:37.790462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac742a5-62a7-4891-8587-39d1770681db None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.801092 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac742a5-62a7-4891-8587-39d1770681db None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.806125 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.806779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.807063 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.807528 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.808268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.810395 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.835979 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1416/2818] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:37 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:37.840177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.850022 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e4e6-8cd9-48f9-b625-448452c2af4a admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.905590 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.906218 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.906506 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.906786 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.907499 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.909470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.928572 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1403/2819] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:37 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:37.932623 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.942752 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7aeb0-c996-4c87-a7d4-9ddda90a545b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.947816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.948502 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.948793 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.949077 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.949808 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.951391 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.962428 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1417/2820] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:37.966194 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:37.976540 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4f8d0-17cb-48b3-b42f-39806f7c8bb4 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:37.981320 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:37.982001 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:37.982307 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:37.982613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:37.983335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:37.984956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b2708-d449-4436-83f4-769f27f77720 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:37.995349 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1404/2821] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:37.999221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.009598 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda464c4-8acb-473b-84ce-8c6dd355827c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.014268 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.015133 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.015419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.015695 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] PATH_INFO: `/v3/projects/7b3b8b8aac1f4a82a47677a6d6e14e50/users/5e8586cdd9394032a741d228489002c6/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.030796 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3b8b8aac1f4a82a47677a6d6e14e50, user_id=5e8586cdd9394032a741d228489002c6, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.033490 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.046467 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1418/2822] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:37 2022] PUT /identity/v3/projects/7b3b8b8aac1f4a82a47677a6d6e14e50/users/5e8586cdd9394032a741d228489002c6/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:38.056465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.056758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.057034 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.083932 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] MFA Rules not processed for user `5e8586cdd9394032a741d228489002c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:38.085729 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:38.124584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:38.148629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1405/2823] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:38.153733 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.221485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8dae2-3982-4c80-957c-eca775fa8847 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.226117 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.226799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.227091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.227371 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.228096 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.229991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.243137 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:38.257678 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1419/2824] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:38.261835 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.272795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72a398-9406-4be5-afeb-5db2521cee52 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.327750 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.328428 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.328714 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.328990 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.329933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.331817 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.350644 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1406/2825] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:38 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:38.355265 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.365678 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bcaef-4f71-4182-93ff-c69c319db09a admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.371247 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.371906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.372227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.372510 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.373245 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.374831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.386056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1420/2826] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:38.390113 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.400003 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76569-2c08-47d4-9449-8d431b680c7d admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.404519 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.405396 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.405680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.405957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] PATH_INFO: `/v3/projects/fa00251aa1c3499fa34b1ce719e71d95/users/ee4303b8bcf94f95a05efed420a4d78a/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.420137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa00251aa1c3499fa34b1ce719e71d95, user_id=ee4303b8bcf94f95a05efed420a4d78a, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.422751 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.436072 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1407/2827] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:38 2022] PUT /identity/v3/projects/fa00251aa1c3499fa34b1ce719e71d95/users/ee4303b8bcf94f95a05efed420a4d78a/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:38.439892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.451202 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436a9e7-9e86-494a-8a07-206f827d8376 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.509432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.510099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.510388 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.510668 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.511394 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.513031 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78601a4b-a141-4648-9ee3-81312a35db4a admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.522786 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1421/2828] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:38.526970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.537109 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30627d7b-75c7-4156-a7f2-0b5e4105f4e0 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.541804 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.542682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.542966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.543247 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] PATH_INFO: `/v3/projects/fa00251aa1c3499fa34b1ce719e71d95/users/ee4303b8bcf94f95a05efed420a4d78a/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.545241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa00251aa1c3499fa34b1ce719e71d95, user_id=ee4303b8bcf94f95a05efed420a4d78a, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.547833 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.558327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1408/2829] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:38 2022] PUT /identity/v3/projects/fa00251aa1c3499fa34b1ce719e71d95/users/ee4303b8bcf94f95a05efed420a4d78a/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:38.569159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.570085 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.570379 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.599917 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] MFA Rules not processed for user `ee4303b8bcf94f95a05efed420a4d78a`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:38.601690 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:38.667191 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1422/2830] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:38.678324 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.680758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:38.737266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744fd-1c90-4558-8f68-66497ba5c465 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.741550 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.742298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.742584 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.742864 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.751908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.753374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.763387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1409/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:38.834991 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:38.844745 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cf802-2c1e-429b-aaa6-a0a3cea1bbd2 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:38.848389 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:38.849018 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:38.849303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:38.849577 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:38.905907 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:38.907341 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c46e4-d2df-43d5-ad7e-7a1a65b06a0f service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:38.916842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1423/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:45.621346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:45.662081 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:45.685360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553770f0-cafe-4d89-b711-007d8e35ed4c service cinder] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:45.689911 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:45.690776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:45.691059 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:45.691335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] PATH_INFO: `/v3/users/5e8586cdd9394032a741d228489002c6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:45.692542 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8586cdd9394032a741d228489002c6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:45.694442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:45.738755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8586cdd9394032a741d228489002c6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:45.739335 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8586cdd9394032a741d228489002c6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:45.746002 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8586cdd9394032a741d228489002c6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:45.752465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8586cdd9394032a741d228489002c6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:45.753152 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8586cdd9394032a741d228489002c6'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:45.769906 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1410/2833] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:45 2022] DELETE /identity/v3/users/5e8586cdd9394032a741d228489002c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:45.774893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:45.775370 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:45.775489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:45.781680 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:45.796500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:45.797698 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:45.855352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1424/2834] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:45.864892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:45.866304 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:45.922182 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1411c4-92eb-4344-97dd-aacc426fdd76 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:45.925776 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:45.926409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:45.926693 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:45.926970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:45.935800 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:45.937242 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:45.946491 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1411/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:46.212156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:46.213601 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:46.225387 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad359c-066e-4d0e-ba52-398c0d6cf492 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:46.230279 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:46.231150 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:46.231439 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:46.231737 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] PATH_INFO: `/v3/projects/7b3b8b8aac1f4a82a47677a6d6e14e50` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:46.232953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3b8b8aac1f4a82a47677a6d6e14e50)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:46.234935 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:46.282313 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3b8b8aac1f4a82a47677a6d6e14e50', 'request_id': 'req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.289410 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3b8b8aac1f4a82a47677a6d6e14e50', 'request_id': 'req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.294929 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3b8b8aac1f4a82a47677a6d6e14e50', 'request_id': 'req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.305489 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] The token cache is being invalidate because project 7b3b8b8aac1f4a82a47677a6d6e14e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:46.305777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.306478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.308056 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1425/2836] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:46 2022] DELETE /identity/v3/projects/7b3b8b8aac1f4a82a47677a6d6e14e50 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:46.312155 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:46.322383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7dd11-540b-4cf1-980c-7d18ce90909b service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:46.377410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:46.378274 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:46.378556 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:46.378834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] PATH_INFO: `/v3/users/ee4303b8bcf94f95a05efed420a4d78a` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:46.380042 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4303b8bcf94f95a05efed420a4d78a)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:46.382612 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:46.384094 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:46.427175 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4303b8bcf94f95a05efed420a4d78a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.427822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4303b8bcf94f95a05efed420a4d78a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.434649 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4303b8bcf94f95a05efed420a4d78a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.441124 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4303b8bcf94f95a05efed420a4d78a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.441775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-15b08e24-936f-4da0-83ad-25f4c8edaeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4303b8bcf94f95a05efed420a4d78a'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.459721 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1412/2837] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:46 2022] DELETE /identity/v3/users/ee4303b8bcf94f95a05efed420a4d78a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:46.731758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:46.733298 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:46.746689 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3166fc1-6eea-4639-b2bd-169b1ba8e48c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:46.804670 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:46.805470 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:46.805758 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:46.806035 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] PATH_INFO: `/v3/projects/fa00251aa1c3499fa34b1ce719e71d95` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:46.807262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa00251aa1c3499fa34b1ce719e71d95)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:46.809218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:46.840105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:46.857079 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa00251aa1c3499fa34b1ce719e71d95', 'request_id': 'req-0c9cff52-93dd-4a34-af35-01192c4ecba0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.864034 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa00251aa1c3499fa34b1ce719e71d95', 'request_id': 'req-0c9cff52-93dd-4a34-af35-01192c4ecba0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.869945 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa00251aa1c3499fa34b1ce719e71d95', 'request_id': 'req-0c9cff52-93dd-4a34-af35-01192c4ecba0'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.880678 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] The token cache is being invalidate because project fa00251aa1c3499fa34b1ce719e71d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:46.880966 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.881617 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-0c9cff52-93dd-4a34-af35-01192c4ecba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:46.883146 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1426/2838] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:46 2022] DELETE /identity/v3/projects/fa00251aa1c3499fa34b1ce719e71d95 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:46.888027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:46.888489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:46.888589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:46.906574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:46.907810 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:46.966726 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1413/2839] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:46.974503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:46.974800 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:46.975083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:46.994099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:46.995296 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:47.003141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1427/2840] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:47.007040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.016636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dd829-0e77-4769-8ed5-90e9570cd69d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.021154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.021794 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.022077 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.022354 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.023080 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:25:47.023388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.025020 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.036330 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1414/2841] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:25:47.041087 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.050278 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a485710-dfea-4f9a-83af-b0fb5de76bdd None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.055440 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.056059 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.056355 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.056630 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.057362 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.059238 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.083967 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1428/2842] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:47.088007 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.097781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1c99-d5c2-410a-b982-0e7f065611ab admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.154261 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.154926 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.155214 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.155492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.156250 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.158151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.168031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:47.182725 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1415/2843] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:47.184152 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.194324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dee7f-0b05-4e3f-88f6-37b97b6be3ed admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.198906 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.199554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.199842 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.200145 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.200869 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.202451 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.213320 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1429/2844] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:47.217008 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.227477 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e9ca-ce0a-45c6-a394-01aa227b41fb admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.232128 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.232775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.233062 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.233342 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.234073 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.235642 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8c142-29f5-4339-a702-0f77aad6b983 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.245387 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1416/2845] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:25:47.249159 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.258740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b55e0-af0f-4ed9-a3d0-14a5a243ad12 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.263289 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.264186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.264474 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.264750 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] PATH_INFO: `/v3/projects/e20dfc2de82843cbb22df16a2fb89345/users/d44c40b26c044b04b1b9047c31a2664c/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.279673 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20dfc2de82843cbb22df16a2fb89345, user_id=d44c40b26c044b04b1b9047c31a2664c, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.282316 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.295183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1430/2846] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:47 2022] PUT /identity/v3/projects/e20dfc2de82843cbb22df16a2fb89345/users/d44c40b26c044b04b1b9047c31a2664c/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:47.306151 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.306386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.306673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.332664 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] MFA Rules not processed for user `d44c40b26c044b04b1b9047c31a2664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:47.333881 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:47.401142 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1417/2847] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:47.405624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.466240 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9384-841a-4107-b4ba-e7c4d96772a9 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.470978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.471638 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.472026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.472315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.473067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.475222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.500418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1431/2848] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:47.504366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.514986 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fec21-b76c-4bcd-b58d-3b1fa495a1ed None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.570305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.570898 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.571189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.571471 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.572224 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.574178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.594820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1418/2849] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:47.598795 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.609681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8516f9-c776-4a90-8e9c-5db24db8afb3 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.614315 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.614972 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.615261 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.615543 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.616306 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.617900 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.628209 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1432/2850] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 09:25:47.632691 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.642685 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e169a-449d-4135-9c06-da0c394997dc admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.647345 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.648809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.649102 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.649386 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] PATH_INFO: `/v3/projects/369e6958b72c4bcb806508f23bd7a287/users/aeef4b77839647e390f26b695509149b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.664147 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369e6958b72c4bcb806508f23bd7a287, user_id=aeef4b77839647e390f26b695509149b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.666834 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.679514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1419/2851] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:47 2022] PUT /identity/v3/projects/369e6958b72c4bcb806508f23bd7a287/users/aeef4b77839647e390f26b695509149b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:47.683413 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.693448 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5173-9842-4e32-a823-f5923cb75679 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.718366 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:47.754213 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.754879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.755171 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.755454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.756221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.758339 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db42e4-fac5-4f8a-b866-a3b6fb7da0e1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.767911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1433/2852] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:47.772014 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.783237 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360d51-47af-4c5b-8244-f20da81c9f13 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.790346 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.791251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.791538 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.791820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] PATH_INFO: `/v3/projects/369e6958b72c4bcb806508f23bd7a287/users/aeef4b77839647e390f26b695509149b/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.793862 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369e6958b72c4bcb806508f23bd7a287, user_id=aeef4b77839647e390f26b695509149b, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.796559 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:47.807000 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1420/2853] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:47 2022] PUT /identity/v3/projects/369e6958b72c4bcb806508f23bd7a287/users/aeef4b77839647e390f26b695509149b/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:47.817033 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.817518 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.817641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.844456 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] MFA Rules not processed for user `aeef4b77839647e390f26b695509149b`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:47.845585 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:47.912276 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1434/2854] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:47.923931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:47.925678 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:47.956241 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:47.983617 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c85d-2690-40f3-9293-ba94feaeaf52 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:47.987360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:47.988021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:47.988319 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:47.988601 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:47.998061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:47.999487 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575235f5-c40b-42ee-8e89-a4cb6c9531be service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:48.009383 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1421/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:48.370974 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:48.433779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9014a46-b33b-4962-bcb3-f8bdceb0b314 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:48.438283 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:48.439147 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:48.439432 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:48.439707 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] PATH_INFO: `/v3/users/d44c40b26c044b04b1b9047c31a2664c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:48.440920 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44c40b26c044b04b1b9047c31a2664c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:48.442960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:48.487702 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44c40b26c044b04b1b9047c31a2664c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:48.489672 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:48.496505 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44c40b26c044b04b1b9047c31a2664c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:48.497165 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44c40b26c044b04b1b9047c31a2664c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:48.503580 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44c40b26c044b04b1b9047c31a2664c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:48.504220 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44c40b26c044b04b1b9047c31a2664c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:48.521098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1435/2856] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:48 2022] DELETE /identity/v3/users/d44c40b26c044b04b1b9047c31a2664c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:48.525535 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:48.525822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:48.526103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:48.544594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:48.545795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:48.603585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1422/2857] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:48.613099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:48.614515 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:48.673478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8642f-475d-4c6d-979c-35e87302a39f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:48.677148 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:48.677825 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:48.678141 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:48.678441 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:48.688126 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:48.689558 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:48.699003 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1436/2858] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:48.981850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:48.983322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:48.996820 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4120e2-92ba-4612-90c1-6a5f64798aeb None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.002013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.003061 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.003356 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.003704 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] PATH_INFO: `/v3/projects/e20dfc2de82843cbb22df16a2fb89345` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.004873 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20dfc2de82843cbb22df16a2fb89345)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.006791 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.052904 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20dfc2de82843cbb22df16a2fb89345', 'request_id': 'req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.058372 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20dfc2de82843cbb22df16a2fb89345', 'request_id': 'req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.065567 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20dfc2de82843cbb22df16a2fb89345', 'request_id': 'req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.077137 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] The token cache is being invalidate because project e20dfc2de82843cbb22df16a2fb89345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:49.077437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.078105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.079908 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1423/2859] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:48 2022] DELETE /identity/v3/projects/e20dfc2de82843cbb22df16a2fb89345 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:49.083799 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.094026 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac90b4-02b4-469a-acf1-b58331822fdd service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.149874 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.150739 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.151021 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.151295 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] PATH_INFO: `/v3/users/aeef4b77839647e390f26b695509149b` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.152506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeef4b77839647e390f26b695509149b)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.154409 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.198994 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeef4b77839647e390f26b695509149b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.206163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeef4b77839647e390f26b695509149b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.206818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeef4b77839647e390f26b695509149b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.214637 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeef4b77839647e390f26b695509149b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.215258 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-e32f9a87-620c-4640-982e-01d2c746e35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeef4b77839647e390f26b695509149b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.222163 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:49.234809 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1437/2860] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:49 2022] DELETE /identity/v3/users/aeef4b77839647e390f26b695509149b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:49.499414 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.500880 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:49.514551 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1f33b-3654-4c6a-8d08-f5886c910ee5 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.565668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:49.576388 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.577289 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.577574 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.577849 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] PATH_INFO: `/v3/projects/369e6958b72c4bcb806508f23bd7a287` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.579029 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=369e6958b72c4bcb806508f23bd7a287)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.581475 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.628648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369e6958b72c4bcb806508f23bd7a287', 'request_id': 'req-1928d47e-1db8-4564-a303-2d4fcf9722f1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.634669 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369e6958b72c4bcb806508f23bd7a287', 'request_id': 'req-1928d47e-1db8-4564-a303-2d4fcf9722f1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.641684 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369e6958b72c4bcb806508f23bd7a287', 'request_id': 'req-1928d47e-1db8-4564-a303-2d4fcf9722f1'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.652749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] The token cache is being invalidate because project 369e6958b72c4bcb806508f23bd7a287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:49.653039 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.653666 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-1928d47e-1db8-4564-a303-2d4fcf9722f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:49.655221 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1424/2861] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:49 2022] DELETE /identity/v3/projects/369e6958b72c4bcb806508f23bd7a287 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:49.660666 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.660960 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.661264 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.679527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:49.680953 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:49.737817 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1438/2862] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:49.746096 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.746327 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.746636 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.765189 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:49.766390 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:49.774178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1425/2863] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:49.778226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.788357 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf67fc-8ddf-435a-95b1-900693c61d14 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.792841 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.793483 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.793765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.794041 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.794760 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:25:49.795067 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.796686 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.808740 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1439/2864] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:25:49.813095 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.822939 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfdbd5-5825-414e-aeb8-f24e7a5747df None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.827603 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.828286 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.828573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.828847 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.829941 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.831832 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.856757 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1426/2865] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:25:49.860856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.871422 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47941d-44d5-4a27-a1ba-bf240a435adf admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.926930 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.927587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.927873 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.928206 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.929491 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.931454 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.950500 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1440/2866] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:49 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:49.954823 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.965127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265d556-9351-475c-b028-a8277c91743f admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:49.969811 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:49.970465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:49.970758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:49.971041 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:49.971836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:49.973468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:49.984529 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1427/2867] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:49.988199 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:49.998449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee880ddf-cfb2-4602-9c90-8727c5d6b7f2 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.002988 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.003624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.003909 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.004214 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.004933 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.006509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e190566-17a1-4c2a-8dba-16721df42d12 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.016208 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1441/2868] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:50.020105 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.029888 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87c9ff-3026-4381-831d-bc4e1c10c1a2 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.034496 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.035366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.035654 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.035935 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] PATH_INFO: `/v3/projects/4f226daafb344f688fc9a2ebda16ec81/users/09e820cc822348a99fbb0307bf799bac/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.050553 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f226daafb344f688fc9a2ebda16ec81, user_id=09e820cc822348a99fbb0307bf799bac, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.053216 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.066532 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1428/2869] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:50 2022] PUT /identity/v3/projects/4f226daafb344f688fc9a2ebda16ec81/users/09e820cc822348a99fbb0307bf799bac/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:50.077660 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.078060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.078404 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.105557 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] MFA Rules not processed for user `09e820cc822348a99fbb0307bf799bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:50.106771 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:50.148877 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:50.170847 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1442/2870] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 09:25:50.175235 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.236850 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87f95-6307-48fc-9d50-ed1c1accf498 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.241547 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.242202 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.242492 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.242775 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.243484 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.245425 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.269910 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1429/2871] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:50 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:50.274274 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.285200 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71c300-190d-4a22-a91c-44e90599b3b6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.340587 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.341248 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.341533 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.341811 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.342501 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.344443 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.364218 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1443/2872] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:50 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:50.368230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.374879 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:50.378822 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba5e1-0596-466a-9131-bac553778e1c admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.384627 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.385322 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.385977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.386366 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.387204 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.389294 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.400504 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1430/2873] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:50.404540 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.415098 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3da736-6961-45c3-a806-6c2b5c0331d1 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.419840 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.420748 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.421036 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.421318 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] PATH_INFO: `/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5/users/14e3f8c67fc04fbcb8517b01457fc2ff/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.437083 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b7c0acdfbb4f2782f856f30465c9c5, user_id=14e3f8c67fc04fbcb8517b01457fc2ff, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.439721 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.452980 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1444/2874] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:50 2022] PUT /identity/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5/users/14e3f8c67fc04fbcb8517b01457fc2ff/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:25:50.456981 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.467498 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c3326-dff8-4045-addf-76dd5694fd14 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.524375 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.524966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.525255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.525534 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.526266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.527853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6fedb-c084-46f8-be66-10ef10abefec admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.537421 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1431/2875] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:50.541492 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.552713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ebb4f-d979-4ab1-998e-94f7783f6bf5 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.557788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.558665 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.558949 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.559225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] PATH_INFO: `/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5/users/14e3f8c67fc04fbcb8517b01457fc2ff/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.561198 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b7c0acdfbb4f2782f856f30465c9c5, user_id=14e3f8c67fc04fbcb8517b01457fc2ff, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.563801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.574478 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1445/2876] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:50 2022] PUT /identity/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5/users/14e3f8c67fc04fbcb8517b01457fc2ff/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:50.584508 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.584801 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.585083 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.611924 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] MFA Rules not processed for user `14e3f8c67fc04fbcb8517b01457fc2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:50.613161 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:50.684568 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1432/2877] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:50.695449 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.697192 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:50.755060 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805941bb-64cd-44f9-b1fa-94753705273e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.758720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.759361 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.759653 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.759940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.768851 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.770277 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b47fb1-d682-412a-bb13-7d86d69ff470 service cinder] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.779864 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1446/2878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:50.807938 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:50.873618 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5ceb2-9ab2-48e1-bfa1-397b22f8305d None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:50.878305 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:50.879178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.879467 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.879783 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] PATH_INFO: `/v3/users/09e820cc822348a99fbb0307bf799bac` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.881021 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e820cc822348a99fbb0307bf799bac)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:50.882969 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:50.898634 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:50.927192 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e820cc822348a99fbb0307bf799bac'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:50.927854 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e820cc822348a99fbb0307bf799bac'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:50.935223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e820cc822348a99fbb0307bf799bac'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:50.942103 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e820cc822348a99fbb0307bf799bac'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:50.942777 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e820cc822348a99fbb0307bf799bac'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:50.960608 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1433/2879] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:50 2022] DELETE /identity/v3/users/09e820cc822348a99fbb0307bf799bac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:50.965121 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:50.965418 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:50.965700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:50.983539 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:50.984763 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:51.016178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:51.042951 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1447/2880] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:51.052430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:51.053809 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:51.111975 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f374e-7502-4fc5-bb67-24150f6e2c2b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:51.115626 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:51.116299 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:51.116585 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:51.116870 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:51.125755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:51.127178 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:51.136592 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1434/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:25:51.395091 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:51.396567 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:51.409139 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b5e8a-7572-4a00-bebb-edd7facd40c6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:51.413757 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:51.414624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:51.414911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:51.415186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] PATH_INFO: `/v3/projects/4f226daafb344f688fc9a2ebda16ec81` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:51.416402 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f226daafb344f688fc9a2ebda16ec81)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:51.418334 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:51.465178 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f226daafb344f688fc9a2ebda16ec81', 'request_id': 'req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.472482 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f226daafb344f688fc9a2ebda16ec81', 'request_id': 'req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.478643 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f226daafb344f688fc9a2ebda16ec81', 'request_id': 'req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.489770 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] The token cache is being invalidate because project 4f226daafb344f688fc9a2ebda16ec81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:51.490485 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.491194 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.492712 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1448/2882] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:51 2022] DELETE /identity/v3/projects/4f226daafb344f688fc9a2ebda16ec81 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:51.496815 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:51.506424 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2ed56-e07d-4d27-9315-6d6e6937daca service neutron] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:51.563579 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:51.564489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:51.564778 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:51.565058 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] PATH_INFO: `/v3/users/14e3f8c67fc04fbcb8517b01457fc2ff` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:51.566246 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e3f8c67fc04fbcb8517b01457fc2ff)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:51.568259 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:51.609270 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:51.616671 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e3f8c67fc04fbcb8517b01457fc2ff'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.617512 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e3f8c67fc04fbcb8517b01457fc2ff'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.624321 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e3f8c67fc04fbcb8517b01457fc2ff'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.632958 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e3f8c67fc04fbcb8517b01457fc2ff'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.633643 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-27bd9017-88ff-442a-95a1-be3245655c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e3f8c67fc04fbcb8517b01457fc2ff'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:51.651013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1435/2883] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:25:51 2022] DELETE /identity/v3/users/14e3f8c67fc04fbcb8517b01457fc2ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:51.919509 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:51.921094 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:51.935300 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937edb-1f57-4ed3-aa29-1fb84bf56d2b admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:51.993419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:51.994314 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:51.994602 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:51.994905 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] PATH_INFO: `/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:51.996135 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b7c0acdfbb4f2782f856f30465c9c5)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:51.998023 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.042506 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b7c0acdfbb4f2782f856f30465c9c5', 'request_id': 'req-c69947be-0c6a-49e9-8b1e-1787ea63fc81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:52.049779 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b7c0acdfbb4f2782f856f30465c9c5', 'request_id': 'req-c69947be-0c6a-49e9-8b1e-1787ea63fc81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:52.056049 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b7c0acdfbb4f2782f856f30465c9c5', 'request_id': 'req-c69947be-0c6a-49e9-8b1e-1787ea63fc81'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:52.057196 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:52.069805 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] The token cache is being invalidate because project 07b7c0acdfbb4f2782f856f30465c9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:25:52.070005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:52.070641 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c69947be-0c6a-49e9-8b1e-1787ea63fc81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:25:52.072232 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1449/2884] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:25:51 2022] DELETE /identity/v3/projects/07b7c0acdfbb4f2782f856f30465c9c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:52.078368 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.078842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.078945 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.097230 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:52.098433 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:52.164877 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1436/2885] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:52.172846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.173144 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.173431 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.191892 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:52.193127 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:52.201019 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1450/2886] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:52.205328 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.214957 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d119e-fe31-4ce3-ac80-2cb0725a03da None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.219489 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.220180 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.220468 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.220748 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.221481 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:25:52.221795 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.223377 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.235309 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1437/2887] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:25:52.239303 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.249415 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aaeb9-d4d6-411b-9362-2276af2a412a None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.253984 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.254621 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.254903 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.255175 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.255861 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.257753 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.283687 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1451/2888] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:25:52 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:25:52.287680 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.298047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f6f5-b3a1-4f29-8eff-a586bb8b6fdd admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.353493 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.354154 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.354442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.354722 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.355409 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.357344 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.376951 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1438/2889] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:25:52 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:25:52.381343 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.391576 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0d4b2-52e4-4ac5-adcc-23ddc5b64608 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.396250 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.396923 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.397183 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.397494 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.398227 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.399818 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.410173 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1452/2890] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:52.414284 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.424298 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcce3f-6acb-4d0f-80af-749be80f0c7c admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.429088 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.429741 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.430030 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.430311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.431047 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.432682 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06c481-5dfc-4e37-affc-8b81066a304d admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.442418 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1439/2891] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:25:52.446741 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.456870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8953-63f4-479c-9c40-84384b36ab0c admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.461594 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.462465 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.462756 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.463046 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] PATH_INFO: `/v3/projects/dd8c02af8f8448f09496e7af8d61c9fb/users/dd3ce101e39a4814a447292f61b91cae/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.478230 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8c02af8f8448f09496e7af8d61c9fb, user_id=dd3ce101e39a4814a447292f61b91cae, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.480925 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.493462 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1453/2892] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:25:52 2022] PUT /identity/v3/projects/dd8c02af8f8448f09496e7af8d61c9fb/users/dd3ce101e39a4814a447292f61b91cae/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:25:52.554158 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.554451 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.554736 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.581403 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] MFA Rules not processed for user `dd3ce101e39a4814a447292f61b91cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:25:52.582616 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:52.592308 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:25:52.649156 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1440/2893] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:25:52.660475 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:25:52.662174 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:25:52.735070 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a529-728c-4041-badb-2bcf1ba32bbc admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:25:52.738589 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06721172c3954f708ed5cae461e62961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:25:52.739221 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:25:52.739534 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:25:52.739815 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:25:52.748472 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:25:52.749893 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd4a80-a59e-4cec-9992-e95ea2de49b3 service glance] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:25:52.759058 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1454/2894] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:25:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:26:02.646255 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=22 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:02.754548 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=60,keystone:INSERT=2 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:11.297106 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:11.358272 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a05edf-664f-48a6-87fd-068fa7753d18 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:11.362859 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:11.363727 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:11.364040 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:11.364323 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] PATH_INFO: `/v3/users/dd3ce101e39a4814a447292f61b91cae` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:11.365514 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3ce101e39a4814a447292f61b91cae)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:11.368024 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:11.411922 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3ce101e39a4814a447292f61b91cae'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.412595 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3ce101e39a4814a447292f61b91cae'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.419455 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3ce101e39a4814a447292f61b91cae'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.426895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3ce101e39a4814a447292f61b91cae'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.427577 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3ce101e39a4814a447292f61b91cae'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.445679 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1441/2895] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:26:11 2022] DELETE /identity/v3/users/dd3ce101e39a4814a447292f61b91cae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:11.450105 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:11.450592 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:11.450701 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:11.467635 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:11.468879 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:11.527180 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1455/2896] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:11.537792 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:11.539407 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:11.597857 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dc550-4d9a-48bd-8d8b-282f9aa9cf54 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:11.602374 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:11.603013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:11.603295 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:11.603575 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:11.614292 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:11.615796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753be0-97d1-4774-818b-a3ceb9f016ea service neutron] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:11.626146 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1442/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:26:11.888575 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:11.890074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:11.905996 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4e791-3f25-40b7-9a63-8fcb6f4e0bd6 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:11.912266 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:11.913681 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:11.913969 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:11.914249 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] PATH_INFO: `/v3/projects/dd8c02af8f8448f09496e7af8d61c9fb` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:11.915471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8c02af8f8448f09496e7af8d61c9fb)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:11.917455 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:11.966131 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8c02af8f8448f09496e7af8d61c9fb', 'request_id': 'req-99030ea5-2214-4733-acf4-1791e7ab55a8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.973007 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8c02af8f8448f09496e7af8d61c9fb', 'request_id': 'req-99030ea5-2214-4733-acf4-1791e7ab55a8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.979332 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8c02af8f8448f09496e7af8d61c9fb', 'request_id': 'req-99030ea5-2214-4733-acf4-1791e7ab55a8'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.990160 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] The token cache is being invalidate because project dd8c02af8f8448f09496e7af8d61c9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:26:11.990452 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.991118 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-99030ea5-2214-4733-acf4-1791e7ab55a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:11.992691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1456/2898] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:26:11 2022] DELETE /identity/v3/projects/dd8c02af8f8448f09496e7af8d61c9fb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:11.997517 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:11.997807 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:11.998086 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.015895 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:12.017126 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:12.033956 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:12.077480 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1443/2899] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:12.085765 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.086064 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.086352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.104859 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:12.106076 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:12.113959 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1457/2900] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:12.117890 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.127311 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f288a-3a86-4bbf-8585-dd648e364093 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.131767 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.132449 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.132735 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.133013 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.133740 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 09:26:12.134051 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.135715 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.146996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1444/2901] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 23 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 09:26:12.151503 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.160644 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce56e2-6ba8-464d-90ed-21ae4d75cb6c None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.165743 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.166381 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.166663 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.166940 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.167628 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.169546 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.194535 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1458/2902] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 09:26:12.197996 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.208453 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfd5eb-fd8f-4e8c-a895-f788e71ff370 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.265084 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.265949 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.266226 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.266511 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.267806 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.270380 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.292760 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1445/2903] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:26:12.298099 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.310080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6b4a-f7bb-4a78-84a6-fa49d3ae479e admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.314832 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.315488 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.315773 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.316084 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.316814 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.318412 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.329211 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1459/2904] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:26:12.333273 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.343968 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76e595-93a7-49b7-9e90-45b6c53c3215 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.348613 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.349266 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.349555 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.349836 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.350573 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.352181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9ea1b-6184-4554-8e16-3cfe3f30cee4 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.362027 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1446/2905] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:26:12.365912 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.375555 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c83089-eb27-4568-9f44-d4ae2a7c2e3f admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.380419 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.381292 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.382078 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.382354 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] PATH_INFO: `/v3/projects/2e71248db33e47f797eaec0e4615bcff/users/56a4e8270a434032a4101223fc121dee/roles/b0d592c729db4128afedc886fb5dece6` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.396667 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e71248db33e47f797eaec0e4615bcff, user_id=56a4e8270a434032a4101223fc121dee, role_id=b0d592c729db4128afedc886fb5dece6)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.399928 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.412471 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1460/2906] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:26:12 2022] PUT /identity/v3/projects/2e71248db33e47f797eaec0e4615bcff/users/56a4e8270a434032a4101223fc121dee/roles/b0d592c729db4128afedc886fb5dece6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 09:26:12.423641 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.423917 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.424223 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.451004 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] MFA Rules not processed for user `56a4e8270a434032a4101223fc121dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:12.452251 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:12.516648 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1447/2907] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:12.521176 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.542375 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:12.584005 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3352-175d-46bf-b3ff-dcabe265fa6d admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.589559 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.590225 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.590511 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.590788 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.591846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.593625 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.621346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1461/2908] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:26:12.625370 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.637668 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e377-4d0e-4e85-af78-e31c7008deb6 None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.650360 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:12.693970 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.695145 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.695430 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.695710 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.696442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.698365 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.718329 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1448/2909] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 09:26:12.722732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.733154 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00c-e24f-4ac4-bbc6-f89572984592 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.737870 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.738554 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.738846 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.739128 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.739856 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.742333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.762411 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1462/2910] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:26:12.766629 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.776933 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29172e67-d8ac-4112-9963-5e82b4eb4ae8 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.781929 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.782838 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.783129 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.783410 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] PATH_INFO: `/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c/users/45fe111525714ca98c69a5d086ed571c/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.798352 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab7ac9cdda4275ba9cb04094083e1c, user_id=45fe111525714ca98c69a5d086ed571c, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.801183 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.814431 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1449/2911] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:26:12 2022] PUT /identity/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c/users/45fe111525714ca98c69a5d086ed571c/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:12.818367 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.829156 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539566f-0015-4459-951a-cd6d6a1da086 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.885182 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.885776 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.886065 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.886346 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.887074 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.888700 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702c932-8e91-4558-9db5-1ff3429fd56f admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.898222 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1463/2912] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 23 09:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 09:26:12.902544 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:12.913187 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fa0bf-64da-4938-b666-73f8ed76d3a7 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:12.918297 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:12.919177 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.919465 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.919749 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] PATH_INFO: `/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c/users/45fe111525714ca98c69a5d086ed571c/roles/10bf172db47a4b9aa18be1ac67449fb2` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.921770 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab7ac9cdda4275ba9cb04094083e1c, user_id=45fe111525714ca98c69a5d086ed571c, role_id=10bf172db47a4b9aa18be1ac67449fb2)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:12.924442 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:12.935031 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1450/2913] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 23 09:26:12 2022] PUT /identity/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c/users/45fe111525714ca98c69a5d086ed571c/roles/10bf172db47a4b9aa18be1ac67449fb2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:12.945720 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] REQUEST_METHOD: `POST` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:12.946108 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:12.946504 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:12.972324 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.auth.core [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] MFA Rules not processed for user `45fe111525714ca98c69a5d086ed571c`. Rule list: `[]` (Enabled: `True`). {{(pid=80403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:12.973527 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:13.040522 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1464/2914] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:13.051111 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:13.052853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:13.130821 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c2dd1-6b05-403f-9ed2-a9e71bf92594 admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:13.134589 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb4b2c43c8b74a2287730da251220971', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:13.135279 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:13.135515 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:13.135796 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:13.190845 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:13.192316 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcff553-826d-4d4f-bee1-a8542e636fe0 service cinder] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:13.201181 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1451/2915] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:26:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:26:15.708401 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:15.726297 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:15.771080 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e7cf-746e-46ea-9fb5-f450fe34cdb8 None None] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:15.775729 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:15.776631 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:15.776911 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:15.777186 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] PATH_INFO: `/v3/users/56a4e8270a434032a4101223fc121dee` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:15.778382 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a4e8270a434032a4101223fc121dee)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:15.780624 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:15.826164 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a4e8270a434032a4101223fc121dee'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:15.833110 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a4e8270a434032a4101223fc121dee'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:15.833772 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a4e8270a434032a4101223fc121dee'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:15.841010 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a4e8270a434032a4101223fc121dee'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:15.841679 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a4e8270a434032a4101223fc121dee'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:15.860777 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1465/2916] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:26:15 2022] DELETE /identity/v3/users/56a4e8270a434032a4101223fc121dee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:15.865138 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] REQUEST_METHOD: `POST` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:15.865623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:15.865745 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:15.879554 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:15.891482 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.auth.core [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] MFA Rules not processed for user `8a167a1095c74cccbf02ec7104075bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 09:26:15.892758 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:15.950423 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1452/2917] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 23 09:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 09:26:15.960226 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:15.961618 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:16.017425 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47132e65-8567-466a-b670-616a97b50966 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:16.021100 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13efde93abb94f78b4cf7b2df191136a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:16.021732 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:16.022020 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:16.022359 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:16.031217 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:16.032722 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:16.042004 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1466/2918] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:26:16.295978 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:16.297594 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:16.310398 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cd7a-c8da-4bae-b232-8b67a8906f5c None None] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:16.315709 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:16.316689 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:16.317050 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:16.317393 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] PATH_INFO: `/v3/projects/2e71248db33e47f797eaec0e4615bcff` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:16.318659 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e71248db33e47f797eaec0e4615bcff)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:16.320853 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:16.368437 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e71248db33e47f797eaec0e4615bcff', 'request_id': 'req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.373780 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e71248db33e47f797eaec0e4615bcff', 'request_id': 'req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.380842 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e71248db33e47f797eaec0e4615bcff', 'request_id': 'req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.391336 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] The token cache is being invalidate because project 2e71248db33e47f797eaec0e4615bcff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:26:16.391623 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.392269 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.393781 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1453/2919] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:26:16 2022] DELETE /identity/v3/projects/2e71248db33e47f797eaec0e4615bcff => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:16.397875 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:16.407696 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d201f-3885-4904-9a92-4df293ec1462 service neutron] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:16.442352 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:16.466697 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:16.467562 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:16.467852 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:16.468155 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] PATH_INFO: `/v3/users/45fe111525714ca98c69a5d086ed571c` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:16.469445 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fe111525714ca98c69a5d086ed571c)` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:16.471333 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:16.517565 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fe111525714ca98c69a5d086ed571c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.524713 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fe111525714ca98c69a5d086ed571c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.525368 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fe111525714ca98c69a5d086ed571c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.532187 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fe111525714ca98c69a5d086ed571c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.532801 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.notifications [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fe111525714ca98c69a5d086ed571c'} {{(pid=80403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.549978 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1467/2920] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 23 09:26:16 2022] DELETE /identity/v3/users/45fe111525714ca98c69a5d086ed571c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:16.822253 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Authenticating user token {{(pid=80402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:26:16.823673 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.fernet_utils [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:26:16.840097 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf149b-c27d-49d4-9bf7-12806b9c2d1b admin admin] Validating token access rules against request {{(pid=80402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:26:16.899470 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a167a1095c74cccbf02ec7104075bd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '281f6db1d408416ba80a23879b0e7fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:26:16.900314 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:26:16.900607 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:26:16.900887 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] PATH_INFO: `/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c` {{(pid=80402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:26:16.902127 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab7ac9cdda4275ba9cb04094083e1c)` {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:26:16.904069 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] RBAC: Authorization granted {{(pid=80402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:26:16.937755 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:16.952812 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab7ac9cdda4275ba9cb04094083e1c', 'request_id': 'req-5651443a-8778-4e86-8ecf-c5c9c69a0328'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.958457 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab7ac9cdda4275ba9cb04094083e1c', 'request_id': 'req-5651443a-8778-4e86-8ecf-c5c9c69a0328'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.965931 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab7ac9cdda4275ba9cb04094083e1c', 'request_id': 'req-5651443a-8778-4e86-8ecf-c5c9c69a0328'} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.976966 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] The token cache is being invalidate because project 54ab7ac9cdda4275ba9cb04094083e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 09:26:16.977257 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.977892 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG keystone.notifications [None req-5651443a-8778-4e86-8ecf-c5c9c69a0328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 09:26:16.979463 dv-cinder-847274-1-smb devstack@keystone.service[80402]: [pid: 80402|app: 0|req: 1454/2921] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 23 09:26:16 2022] DELETE /identity/v3/projects/54ab7ac9cdda4275ba9cb04094083e1c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 09:26:26.546444 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:26:26.973977 dv-cinder-847274-1-smb devstack@keystone.service[80402]: DEBUG dbcounter [-] [80402] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 09:29:26.764461 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Authenticating user token {{(pid=80403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 09:29:26.765865 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:29:26.833850 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2a46-f40e-4baa-9fbc-6f5b54be7af4 admin admin] Validating token access rules against request {{(pid=80403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 09:29:26.891647 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '503e24d396e2421bb0df4392288ac658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942b1b6d34064b149c63afa240ed7640', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 09:29:26.892262 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] REQUEST_METHOD: `GET` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 09:29:26.892552 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 09:29:26.892831 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 09:29:26.894610 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.fernet_utils [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 09:29:26.905816 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 09:29:26.907882 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11092824-e984-4ba2-a36b-aa38f4f36dd4 service placement] RBAC: Authorization granted {{(pid=80403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 09:29:26.917691 dv-cinder-847274-1-smb devstack@keystone.service[80403]: [pid: 80403|app: 0|req: 1468/2922] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 23 09:29:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 09:29:36.913556 dv-cinder-847274-1-smb devstack@keystone.service[80403]: DEBUG dbcounter [-] [80403] Writing DB stats keystone:SELECT=58 {{(pid=80403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}